Nov 29 21:41:15 user nova-compute[75206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75206) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 21:41:15 user nova-compute[75206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75206) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 21:41:15 user nova-compute[75206]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75206) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 21:41:15 user nova-compute[75206]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 21:41:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:41:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:41:16 user nova-compute[75206]: INFO nova.virt.driver [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 21:41:16 user nova-compute[75206]: INFO nova.compute.provider_config [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Acquiring lock "singleton_lock" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Acquired lock "singleton_lock" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Releasing lock "singleton_lock" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Full set of CONF: {{(pid=75206) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ******************************************************************************** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Configuration options gathered from: {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ================================================================================ {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] allow_resize_to_same_host      = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] arq_binding_timeout            = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] backdoor_port                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] backdoor_socket                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] block_device_allocate_retries  = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] block_device_allocate_retries_interval = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cert                           = self.pem {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute_monitors               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] config_dir                     = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] config_drive_format            = iso9660 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] config_source                  = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] console_host                   = user {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] control_exchange               = nova {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cpu_allocation_ratio           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] daemon                         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] debug                          = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_access_ip_network_name = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_availability_zone      = nova {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_ephemeral_format       = ext4 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_green_pool_size        = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] default_schedule_zone          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] disk_allocation_ratio          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] enable_new_services            = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] enabled_ssl_apis               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] flat_injected                  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] force_config_drive             = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] force_raw_images               = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] graceful_shutdown_timeout      = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] heal_instance_info_cache_interval = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] host                           = user {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_build_timeout         = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_delete_interval       = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_name_template         = instance-%08x {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_usage_audit           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_usage_audit_period    = month {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] internal_service_availability_zone = internal {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] key                            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] live_migration_retry_count     = 30 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_config_append              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_dir                        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_file                       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_options                    = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_rotate_interval            = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_rotate_interval_type       = days {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] log_rotation_type              = none {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] long_rpc_timeout               = 1800 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_concurrent_builds          = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_concurrent_live_migrations = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_concurrent_snapshots       = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_local_block_devices        = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_logfile_count              = 30 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] max_logfile_size_mb            = 200 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] maximum_instance_delete_attempts = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metadata_listen                = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metadata_listen_port           = 8775 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metadata_workers               = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] migrate_max_retries            = -1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] mkisofs_cmd                    = genisoimage {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] my_ip                          = 10.0.0.210 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] network_allocate_retries       = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] osapi_compute_listen_port      = 8774 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] osapi_compute_unique_server_name_scope =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] osapi_compute_workers          = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] password_length                = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] periodic_enable                = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] periodic_fuzzy_delay           = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] pointer_model                  = ps2mouse {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] preallocate_images             = none {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] publish_errors                 = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] pybasedir                      = /opt/stack/nova {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ram_allocation_ratio           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rate_limit_burst               = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rate_limit_except_level        = CRITICAL {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rate_limit_interval            = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reboot_timeout                 = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reclaim_instance_interval      = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] record                         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reimage_timeout_per_gb         = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] report_interval                = 120 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rescue_timeout                 = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reserved_host_cpus             = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reserved_host_disk_mb          = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reserved_host_memory_mb        = 512 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] reserved_huge_pages            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] resize_confirm_window          = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] resize_fs_using_block_device   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] resume_guests_state_on_host_boot = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rpc_response_timeout           = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] run_external_periodic_tasks    = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] running_deleted_instance_action = reap {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] running_deleted_instance_timeout = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler_instance_sync_interval = 120 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_down_time              = 720 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] servicegroup_driver            = db {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] shelved_offload_time           = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] shelved_poll_interval          = 3600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] shutdown_timeout               = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] source_is_ipv6                 = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ssl_only                       = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] state_path                     = /opt/stack/data/nova {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] sync_power_state_interval      = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] sync_power_state_pool_size     = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] syslog_log_facility            = LOG_USER {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] tempdir                        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] timeout_nbd                    = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] transport_url                  = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] update_resources_interval      = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_cow_images                 = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_eventlog                   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_journal                    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_json                       = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_rootwrap_daemon            = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_stderr                     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] use_syslog                     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vcpu_pin_set                   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plugging_is_fatal          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plugging_timeout           = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] virt_mkfs                      = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] volume_usage_poll_interval     = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] watch_log_file                 = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] web                            = /usr/share/spice-html5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_concurrency.disable_process_locking = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.auth_strategy              = keystone {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.compute_link_prefix        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.dhcp_domain                = novalocal {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.enable_instance_password   = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.glance_link_prefix         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.instance_list_per_project_cells = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.list_records_by_skipping_down_cells = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.local_metadata_per_cell    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.max_limit                  = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.metadata_cache_expiration  = 15 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.neutron_default_tenant_id  = default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.use_forwarded_for          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.use_neutron_default_nets   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_dynamic_targets = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_jsonfile_path   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.backend_argument         = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.config_prefix            = cache.oslo {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.dead_timeout             = 60.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.debug_cache_backend      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.enable_retry_client      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.enable_socket_keepalive  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.enabled                  = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.expiration_time          = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.hashclient_retry_attempts = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_dead_retry      = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_password        =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_sasl_enabled    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.memcache_username        =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.proxies                  = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.retry_attempts           = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.retry_delay              = 0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.socket_keepalive_count   = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.socket_keepalive_idle    = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.socket_keepalive_interval = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.tls_allowed_ciphers      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.tls_cafile               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.tls_certfile             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.tls_enabled              = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cache.tls_keyfile              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.auth_section            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.auth_type               = password {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.cafile                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.certfile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.collect_timing          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.cross_az_attach         = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.debug                   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.endpoint_template       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.http_retries            = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.insecure                = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.keyfile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.os_region_name          = RegionOne {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.split_loggers           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cinder.timeout                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.cpu_dedicated_set      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.cpu_shared_set         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.image_type_exclude_list = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.resource_provider_association_refresh = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.shutdown_retry_interval = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] conductor.workers              = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] console.allowed_origins        = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] console.ssl_ciphers            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] console.ssl_minimum_version    = default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] consoleauth.token_ttl          = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.cafile                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.certfile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.collect_timing          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.connect_retries         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.connect_retry_delay     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.endpoint_override       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.insecure                = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.keyfile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.max_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.min_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.region_name             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.service_name            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.service_type            = accelerator {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.split_loggers           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.status_code_retries     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.timeout                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] cyborg.version                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.backend               = sqlalchemy {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.connection            = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.connection_debug      = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.connection_parameters =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.connection_recycle_time = 3600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.connection_trace      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.db_inc_retry_interval = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.db_max_retries        = 20 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.db_max_retry_interval = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.db_retry_interval     = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.max_overflow          = 50 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.max_pool_size         = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.max_retries           = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.mysql_wsrep_sync_wait = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.pool_timeout          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.retry_interval        = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.slave_connection      = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] database.sqlite_synchronous    = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.backend           = sqlalchemy {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.connection        = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.connection_debug  = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.connection_parameters =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.connection_recycle_time = 3600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.connection_trace  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.db_inc_retry_interval = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.db_max_retries    = 20 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.db_max_retry_interval = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.db_retry_interval = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.max_overflow      = 50 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.max_pool_size     = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.max_retries       = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.pool_timeout      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.retry_interval    = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.slave_connection  = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] api_database.sqlite_synchronous = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] devices.enabled_mdev_types     = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ephemeral_storage_encryption.enabled = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.api_servers             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.cafile                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.certfile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.collect_timing          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.connect_retries         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.connect_retry_delay     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.debug                   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.default_trusted_certificate_ids = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.enable_certificate_validation = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.enable_rbd_download     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.endpoint_override       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.insecure                = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.keyfile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.max_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.min_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.num_retries             = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.rbd_ceph_conf           =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.rbd_connect_timeout     = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.rbd_pool                =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.rbd_user                =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.region_name             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.service_name            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.service_type            = image {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.split_loggers           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.status_code_retries     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.timeout                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.verify_glance_signatures = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] glance.version                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] guestfs.debug                  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.config_drive_cdrom      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.config_drive_inject_password = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.enable_remotefx         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.instances_path_share    =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.limit_cpu_features      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.use_multipath_io        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.vswitch_name            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] mks.enabled                    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.manager_interval   = 2400 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.precache_concurrency = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.remove_unused_base_images = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] image_cache.subdirectory_name  = _base {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.api_max_retries         = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.api_retry_interval      = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.auth_section            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.auth_type               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.cafile                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.certfile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.collect_timing          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.conductor_group         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.connect_retries         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.connect_retry_delay     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.endpoint_override       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.insecure                = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.keyfile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.max_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.min_version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.peer_list               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.region_name             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.serial_console_state_timeout = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.service_name            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.service_type            = baremetal {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.split_loggers           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.status_code_retries     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.timeout                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ironic.version                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] key_manager.fixed_key          = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.barbican_api_version  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.barbican_endpoint     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.barbican_endpoint_type = public {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.barbican_region_name  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.cafile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.certfile              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.collect_timing        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.insecure              = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.keyfile               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.number_of_retries     = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.retry_delay           = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.send_service_user_token = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.split_loggers         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.timeout               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.verify_ssl            = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican.verify_ssl_path       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.auth_section = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.auth_type = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.cafile   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.certfile = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.collect_timing = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.insecure = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.keyfile  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.split_loggers = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] barbican_service_user.timeout  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.approle_role_id          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.approle_secret_id        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.cafile                   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.certfile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.collect_timing           = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.insecure                 = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.keyfile                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.kv_mountpoint            = secret {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.kv_path                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.kv_version               = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.namespace                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.root_token_id            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.split_loggers            = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.ssl_ca_crt_file          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.timeout                  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.use_ssl                  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.auth_section          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.auth_type             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.cafile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.certfile              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.collect_timing        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.connect_retries       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.connect_retry_delay   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.endpoint_override     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.insecure              = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.keyfile               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.max_version           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.min_version           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.region_name           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.service_name          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.service_type          = identity {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.split_loggers         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.status_code_retries   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.timeout               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] keystone.version               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.connection_uri         =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_mode               = custom {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: WARNING oslo_config.cfg [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_power_governor_high = performance {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_power_management   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.device_detach_attempts = 8 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.device_detach_timeout  = 20 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.disk_cachemodes        = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.disk_prefix            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.enabled_perf_events    = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.file_backed_memory     = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.gid_maps               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.hw_disk_discard        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.hw_machine_type        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_rbd_pool        = rbd {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_type            = default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.images_volume_group    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.inject_key             = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.inject_partition       = -2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.inject_password        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.iscsi_iface            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.iser_use_multipath     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_downtime = 500 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_inbound_addr = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_scheme  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_timeout_action = abort {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_tunnelled = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: WARNING oslo_config.cfg [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 21:41:16 user nova-compute[75206]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 21:41:16 user nova-compute[75206]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 21:41:16 user nova-compute[75206]: and ``live_migration_inbound_addr`` respectively.
Nov 29 21:41:16 user nova-compute[75206]: ).  Its value may be silently ignored in the future.
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.live_migration_with_native_tls = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.max_queues             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.nfs_mount_options      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_pcie_ports         = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.pmem_namespaces        = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.quobyte_client_cfg     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rbd_secret_uuid        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rbd_user               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rescue_image_id        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rescue_kernel_id       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.rx_queue_size          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.smbfs_mount_options    =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.snapshot_compression   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.snapshot_image_format  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.sparse_logical_volumes = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.swtpm_enabled          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.swtpm_group            = tss {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.swtpm_user             = tss {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.sysinfo_serial         = unique {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.tb_cache_size          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.tx_queue_size          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.uid_maps               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.use_virtio_for_bridges = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.virt_type              = kvm {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.volume_clear           = zero {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.volume_clear_size      = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.volume_use_multipath   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_cache_path   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.auth_section           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.auth_type              = password {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.cafile                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.certfile               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.collect_timing         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.connect_retries        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.connect_retry_delay    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.default_floating_pool  = public {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.endpoint_override      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.extension_sync_interval = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.http_retries           = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.insecure               = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.keyfile                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.max_version            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.min_version            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.ovs_bridge             = br-int {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.physnets               = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.region_name            = RegionOne {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.service_metadata_proxy = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.service_name           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.service_type           = network {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.split_loggers          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.status_code_retries    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.timeout                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] neutron.version                = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] notifications.bdms_in_notifications = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] notifications.default_level    = INFO {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] notifications.notification_format = unversioned {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] notifications.notify_on_state_change = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] pci.alias                      = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] pci.device_spec                = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] pci.report_in_placement        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.auth_section         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.auth_type            = password {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.cafile               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.certfile             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.collect_timing       = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.connect_retries      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.connect_retry_delay  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.default_domain_id    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.default_domain_name  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.domain_id            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.domain_name          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.endpoint_override    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.insecure             = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.keyfile              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.max_version          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.min_version          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.password             = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.project_domain_id    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.project_domain_name  = Default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.project_id           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.project_name         = service {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.region_name          = RegionOne {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.service_name         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.service_type         = placement {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.split_loggers        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.status_code_retries  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.system_scope         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.timeout              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.trust_id             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.user_domain_id       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.user_domain_name     = Default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.user_id              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.username             = placement {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] placement.version              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.cores                    = 20 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.count_usage_from_placement = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.injected_file_content_bytes = 10240 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.injected_file_path_length = 255 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.injected_files           = 5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.instances                = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.key_pairs                = 100 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.metadata_items           = 128 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.ram                      = 51200 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.recheck_quota            = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.server_group_members     = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] quota.server_groups            = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rdp.enabled                    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.image_metadata_prefilter = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.max_attempts         = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.max_placement_results = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] scheduler.workers              = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.host_subset_size = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.isolated_hosts = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.isolated_images = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.pci_in_placement = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.track_instance_changes = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metrics.required               = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metrics.weight_multiplier      = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] metrics.weight_setting         = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.enabled         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.port_range      = 10000:20000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] serial_console.serialproxy_port = 6083 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.auth_section      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.auth_type         = password {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.cafile            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.certfile          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.collect_timing    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.insecure          = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.keyfile           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.send_service_user_token = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.split_loggers     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] service_user.timeout           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.agent_enabled            = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.enabled                  = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.html5proxy_port          = 6082 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.image_compression        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.jpeg_compression         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.playback_compression     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.server_listen            = 127.0.0.1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.streaming_mode           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] spice.zlib_compression         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] upgrade_levels.baseapi         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] upgrade_levels.compute         = auto {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] upgrade_levels.conductor       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] upgrade_levels.scheduler       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.cafile = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.certfile = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.insecure = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vendordata_dynamic_auth.timeout = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.api_retry_count         = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.ca_file                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.cache_prefix            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.cluster_name            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.connection_pool_size    = 10 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.console_delay_seconds   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.datastore_regex         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.host_ip                 = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.host_password           = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.host_port               = 443 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.host_username           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.insecure                = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.integration_bridge      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.maximum_objects         = 100 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.pbm_default_policy      = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.pbm_enabled             = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.pbm_wsdl_location       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.serial_port_proxy_uri   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.serial_port_service_uri = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.task_poll_interval      = 0.5 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.use_linked_clone        = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.vnc_keymap              = en-us {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.vnc_port                = 5900 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vmware.vnc_port_total          = 10000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.auth_schemes               = ['none'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.enabled                    = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.novncproxy_port            = 6080 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.vencrypt_ca_certs          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.vencrypt_client_cert       = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vnc.vencrypt_client_key        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.disable_rootwrap   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.enable_numa_live_migration = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.libvirt_disable_apic = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.client_socket_timeout     = 900 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.default_pool_size         = 1000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.keep_alive                = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.max_header_line           = 16384 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.ssl_ca_file               = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.ssl_cert_file             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.ssl_key_file              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.tcp_keepidle              = 600 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] zvm.ca_file                    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] zvm.cloud_connector_url        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] zvm.reachable_timeout          = 300 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.enforce_new_defaults = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.enforce_scope      = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.policy_default_rule = default {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.connection_string     = messaging:// {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.enabled               = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.es_doc_type           = notification {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.es_scroll_size        = 10000 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.es_scroll_time        = 2m {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.filter_error_trace    = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.hmac_keys             = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.sentinel_service_name = mymaster {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.socket_timeout        = 0.1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.trace_requests        = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler.trace_sqlalchemy      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler_jaeger.process_tags   = {} {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler_jaeger.service_name_prefix = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] profiler_otlp.service_name_prefix = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] remote_debug.host              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] remote_debug.port              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_notifications.retry = -1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.auth_section        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.auth_type           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.cafile              = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.certfile            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.collect_timing      = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.connect_retries     = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.connect_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.endpoint_id         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.endpoint_override   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.insecure            = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.keyfile             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.max_version         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.min_version         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.region_name         = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.service_name        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.service_type        = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.split_loggers       = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.status_code_retries = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.status_code_retry_delay = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.timeout             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.valid_interfaces    = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_limit.version             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_reports.file_event_handler = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] oslo_reports.log_dir           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.group  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] vif_plug_ovs_privileged.user   = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.isolate_vif         = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] os_brick.lock_path             = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.capabilities   = [21] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.group          = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.helper_command = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] privsep_osbrick.user           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.group           = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.helper_command  = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] nova_sys_admin.user            = None {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG oslo_service.service [None req-95502a06-681f-4c1d-8a8d-4e87db288499 None None] ******************************************************************************** {{(pid=75206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 21:41:16 user nova-compute[75206]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Connecting to libvirt: qemu:///system {{(pid=75206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f24c9f76410> {{(pid=75206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 21:41:16 user nova-compute[75206]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 21:41:16 user nova-compute[75206]: WARNING nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f24c9f76410> {{(pid=75206) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Starting native event thread {{(pid=75206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Starting green dispatch thread {{(pid=75206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Starting connection event dispatch thread {{(pid=75206) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 21:41:16 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Connection event '1' reason 'None'
Nov 29 21:41:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 21:41:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.mount [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Initialising _HostMountState generation 0 {{(pid=75206) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host capabilities <capabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <host>
Nov 29 21:41:24 user nova-compute[75206]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 21:41:24 user nova-compute[75206]:     <cpu>
Nov 29 21:41:24 user nova-compute[75206]:       <arch>x86_64</arch>
Nov 29 21:41:24 user nova-compute[75206]:       <model>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <microcode version='1070'/>
Nov 29 21:41:24 user nova-compute[75206]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='osxsave'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='invtsc'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='rsba'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 21:41:24 user nova-compute[75206]:       <pages unit='KiB' size='4'/>
Nov 29 21:41:24 user nova-compute[75206]:       <pages unit='KiB' size='2048'/>
Nov 29 21:41:24 user nova-compute[75206]:     </cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <power_management>
Nov 29 21:41:24 user nova-compute[75206]:       <suspend_mem/>
Nov 29 21:41:24 user nova-compute[75206]:       <suspend_disk/>
Nov 29 21:41:24 user nova-compute[75206]:       <suspend_hybrid/>
Nov 29 21:41:24 user nova-compute[75206]:     </power_management>
Nov 29 21:41:24 user nova-compute[75206]:     <iommu support='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <migration_features>
Nov 29 21:41:24 user nova-compute[75206]:       <live/>
Nov 29 21:41:24 user nova-compute[75206]:       <uri_transports>
Nov 29 21:41:24 user nova-compute[75206]:         <uri_transport>tcp</uri_transport>
Nov 29 21:41:24 user nova-compute[75206]:         <uri_transport>rdma</uri_transport>
Nov 29 21:41:24 user nova-compute[75206]:       </uri_transports>
Nov 29 21:41:24 user nova-compute[75206]:     </migration_features>
Nov 29 21:41:24 user nova-compute[75206]:     <topology>
Nov 29 21:41:24 user nova-compute[75206]:       <cells num='2'>
Nov 29 21:41:24 user nova-compute[75206]:         <cell id='0'>
Nov 29 21:41:24 user nova-compute[75206]:           <memory unit='KiB'>8140616</memory>
Nov 29 21:41:24 user nova-compute[75206]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 21:41:24 user nova-compute[75206]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 21:41:24 user nova-compute[75206]:           <distances>
Nov 29 21:41:24 user nova-compute[75206]:             <sibling id='0' value='10'/>
Nov 29 21:41:24 user nova-compute[75206]:             <sibling id='1' value='20'/>
Nov 29 21:41:24 user nova-compute[75206]:           </distances>
Nov 29 21:41:24 user nova-compute[75206]:           <cpus num='6'>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 21:41:24 user nova-compute[75206]:           </cpus>
Nov 29 21:41:24 user nova-compute[75206]:         </cell>
Nov 29 21:41:24 user nova-compute[75206]:         <cell id='1'>
Nov 29 21:41:24 user nova-compute[75206]:           <memory unit='KiB'>8255100</memory>
Nov 29 21:41:24 user nova-compute[75206]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 29 21:41:24 user nova-compute[75206]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 21:41:24 user nova-compute[75206]:           <distances>
Nov 29 21:41:24 user nova-compute[75206]:             <sibling id='0' value='20'/>
Nov 29 21:41:24 user nova-compute[75206]:             <sibling id='1' value='10'/>
Nov 29 21:41:24 user nova-compute[75206]:           </distances>
Nov 29 21:41:24 user nova-compute[75206]:           <cpus num='6'>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 21:41:24 user nova-compute[75206]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 21:41:24 user nova-compute[75206]:           </cpus>
Nov 29 21:41:24 user nova-compute[75206]:         </cell>
Nov 29 21:41:24 user nova-compute[75206]:       </cells>
Nov 29 21:41:24 user nova-compute[75206]:     </topology>
Nov 29 21:41:24 user nova-compute[75206]:     <cache>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 21:41:24 user nova-compute[75206]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 21:41:24 user nova-compute[75206]:     </cache>
Nov 29 21:41:24 user nova-compute[75206]:     <secmodel>
Nov 29 21:41:24 user nova-compute[75206]:       <model>apparmor</model>
Nov 29 21:41:24 user nova-compute[75206]:       <doi>0</doi>
Nov 29 21:41:24 user nova-compute[75206]:     </secmodel>
Nov 29 21:41:24 user nova-compute[75206]:     <secmodel>
Nov 29 21:41:24 user nova-compute[75206]:       <model>dac</model>
Nov 29 21:41:24 user nova-compute[75206]:       <doi>0</doi>
Nov 29 21:41:24 user nova-compute[75206]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 21:41:24 user nova-compute[75206]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 21:41:24 user nova-compute[75206]:     </secmodel>
Nov 29 21:41:24 user nova-compute[75206]:   </host>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='alpha'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>clipper</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='armv6l'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>spitz</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>nuri</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>kzm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>z2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>tosa</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n810</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>terrier</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>midway</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>microbit</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>verdex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>highbank</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>akita</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>connex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>collie</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='armv7l'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>spitz</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>nuri</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>kzm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>z2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>tosa</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n810</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>terrier</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>midway</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>microbit</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>verdex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>highbank</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>akita</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>connex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>collie</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='aarch64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>spitz</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>nuri</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>kzm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>z2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>tosa</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n810</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>n800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>terrier</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>midway</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>microbit</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>verdex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>highbank</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>akita</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>connex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>collie</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <acpi default='on' toggle='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='cris'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='i686'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>isapc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>microvm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='kvm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <pae/>
Nov 29 21:41:24 user nova-compute[75206]:       <nonpae/>
Nov 29 21:41:24 user nova-compute[75206]:       <acpi default='on' toggle='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:       <apic default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='m68k'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>an5206</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>q800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='microblaze'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='microblazeel'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='mips'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>malta</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='mipsel'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>malta</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='mips64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>malta</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>pica61</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>magnum</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='mips64el'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>malta</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>pica61</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>magnum</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='16'>boston</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='ppc'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mac99</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>40p</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>taihu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='ppc64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>taihu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>40p</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mac99</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='ppc64le'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>taihu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>40p</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>mac99</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='riscv32'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='8'>spike</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='8'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='riscv64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='8'>spike</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='8'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='s390x'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='sh4'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>shix</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>r2d</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='sh4eb'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>shix</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>r2d</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='sparc'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>LX</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='sparc64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>niagara</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='x86_64'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>64</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='1'>isapc</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>microvm</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='kvm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <acpi default='on' toggle='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:       <apic default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='xtensa'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>sim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>kc705</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ml605</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx200</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx60</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]:   <guest>
Nov 29 21:41:24 user nova-compute[75206]:     <os_type>hvm</os_type>
Nov 29 21:41:24 user nova-compute[75206]:     <arch name='xtensaeb'>
Nov 29 21:41:24 user nova-compute[75206]:       <wordsize>32</wordsize>
Nov 29 21:41:24 user nova-compute[75206]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='4'>sim</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>kc705</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ml605</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>virt</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx200</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>lx60</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 21:41:24 user nova-compute[75206]:       <domain type='qemu'/>
Nov 29 21:41:24 user nova-compute[75206]:     </arch>
Nov 29 21:41:24 user nova-compute[75206]:     <features>
Nov 29 21:41:24 user nova-compute[75206]:       <cpuselection/>
Nov 29 21:41:24 user nova-compute[75206]:       <deviceboot/>
Nov 29 21:41:24 user nova-compute[75206]:       <disksnapshot default='on' toggle='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     </features>
Nov 29 21:41:24 user nova-compute[75206]:   </guest>
Nov 29 21:41:24 user nova-compute[75206]: </capabilities>
Nov 29 21:41:24 user nova-compute[75206]: 
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-q35-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>i686</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='288'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'/>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='lm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-i440fx-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>i686</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='255'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'/>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='lm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ide</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-q35-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>i686</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='288'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'/>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='lm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-i440fx-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>i686</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='255'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'/>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='lm'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ide</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-q35-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>x86_64</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='288'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>efi</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='invtsc'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='rsba'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-i440fx-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>x86_64</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='255'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>efi</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='invtsc'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='rsba'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ide</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-q35-6.2</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>x86_64</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='288'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>efi</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='invtsc'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='rsba'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 21:41:24 user nova-compute[75206]: <domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 21:41:24 user nova-compute[75206]:   <domain>kvm</domain>
Nov 29 21:41:24 user nova-compute[75206]:   <machine>pc-i440fx-jammy</machine>
Nov 29 21:41:24 user nova-compute[75206]:   <arch>x86_64</arch>
Nov 29 21:41:24 user nova-compute[75206]:   <vcpu max='255'/>
Nov 29 21:41:24 user nova-compute[75206]:   <iothreads supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:   <os supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='firmware'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>efi</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:     <loader supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>rom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pflash</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='readonly'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>yes</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='secure'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>no</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </loader>
Nov 29 21:41:24 user nova-compute[75206]:   </os>
Nov 29 21:41:24 user nova-compute[75206]:   <cpu>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-passthrough' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='hostPassthroughMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='maximum' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='maximumMigratable'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>on</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>off</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='host-model' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <vendor>Intel</vendor>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ss'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='vmx'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pcid'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='hypervisor'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arat'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='umip'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='md-clear'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='invtsc'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibpb'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='ibrs'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-stibp'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='rsba'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='erms'/>
Nov 29 21:41:24 user nova-compute[75206]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:     <mode name='custom' supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>qemu64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>qemu32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>phenom</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>pentium</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>n270</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm64</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>kvm32</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>coreduo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>core2duo</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>athlon</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Westmere</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Snowridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Skylake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>SandyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Penryn</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G5</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G4</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G3</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Opteron_G2</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Opteron_G1</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>IvyBridge</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Icelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Haswell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Rome</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-Milan</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>EPYC</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Dhyana</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cooperlake</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>Conroe</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='no'>Broadwell</model>
Nov 29 21:41:24 user nova-compute[75206]:       <model usable='yes'>486</model>
Nov 29 21:41:24 user nova-compute[75206]:     </mode>
Nov 29 21:41:24 user nova-compute[75206]:   </cpu>
Nov 29 21:41:24 user nova-compute[75206]:   <memoryBacking supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:     <enum name='sourceType'>
Nov 29 21:41:24 user nova-compute[75206]:       <value>file</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>anonymous</value>
Nov 29 21:41:24 user nova-compute[75206]:       <value>memfd</value>
Nov 29 21:41:24 user nova-compute[75206]:     </enum>
Nov 29 21:41:24 user nova-compute[75206]:   </memoryBacking>
Nov 29 21:41:24 user nova-compute[75206]:   <devices>
Nov 29 21:41:24 user nova-compute[75206]:     <disk supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='diskDevice'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>disk</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cdrom</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>floppy</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>lun</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='bus'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ide</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>fdc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sata</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </disk>
Nov 29 21:41:24 user nova-compute[75206]:     <graphics supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='type'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>sdl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vnc</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>spice</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egl-headless</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </graphics>
Nov 29 21:41:24 user nova-compute[75206]:     <video supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='modelType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>cirrus</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>vmvga</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>qxl</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>none</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>bochs</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>ramfb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </video>
Nov 29 21:41:24 user nova-compute[75206]:     <hostdev supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='mode'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>subsystem</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='startupPolicy'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>default</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>mandatory</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>requisite</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>optional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='subsysType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>usb</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>pci</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>scsi</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='capsType'/>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='pciBackend'/>
Nov 29 21:41:24 user nova-compute[75206]:     </hostdev>
Nov 29 21:41:24 user nova-compute[75206]:     <rng supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtio-non-transitional</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>random</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>egd</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>builtin</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </rng>
Nov 29 21:41:24 user nova-compute[75206]:     <filesystem supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='driverType'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>path</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>handle</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>virtiofs</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </filesystem>
Nov 29 21:41:24 user nova-compute[75206]:     <tpm supported='yes'>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='model'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-tis</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>tpm-crb</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:       <enum name='backendModel'>
Nov 29 21:41:24 user nova-compute[75206]:         <value>passthrough</value>
Nov 29 21:41:24 user nova-compute[75206]:         <value>emulator</value>
Nov 29 21:41:24 user nova-compute[75206]:       </enum>
Nov 29 21:41:24 user nova-compute[75206]:     </tpm>
Nov 29 21:41:24 user nova-compute[75206]:   </devices>
Nov 29 21:41:24 user nova-compute[75206]:   <features>
Nov 29 21:41:24 user nova-compute[75206]:     <gic supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:     <vmcoreinfo supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <genid supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backingStoreInput supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <backup supported='yes'/>
Nov 29 21:41:24 user nova-compute[75206]:     <sev supported='no'/>
Nov 29 21:41:24 user nova-compute[75206]:   </features>
Nov 29 21:41:24 user nova-compute[75206]: </domainCapabilities>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75206) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75206) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Checking secure boot support for host arch (x86_64) {{(pid=75206) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Secure Boot support detected
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] cpu compare xml: <cpu match="exact">
Nov 29 21:41:24 user nova-compute[75206]:   <model>Nehalem</model>
Nov 29 21:41:24 user nova-compute[75206]: </cpu>
Nov 29 21:41:24 user nova-compute[75206]:  {{(pid=75206) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.virt.node [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Generated node identity 51ff9dac-8442-4423-a757-45ab0a497b95
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.virt.node [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Wrote node identity 51ff9dac-8442-4423-a757-45ab0a497b95 to /opt/stack/data/nova/compute_id
Nov 29 21:41:24 user nova-compute[75206]: WARNING nova.compute.manager [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Compute nodes ['51ff9dac-8442-4423-a757-45ab0a497b95'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.compute.manager [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 21:41:24 user nova-compute[75206]: WARNING nova.compute.manager [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 21:41:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:41:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:41:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Hypervisor/Node resource view: name=user free_ram=11007MB free_disk=26.062789916992188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:41:24 user nova-compute[75206]: WARNING nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] No compute node record for user:51ff9dac-8442-4423-a757-45ab0a497b95: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 51ff9dac-8442-4423-a757-45ab0a497b95 could not be found.
Nov 29 21:41:24 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Compute node record created for user:user with uuid: 51ff9dac-8442-4423-a757-45ab0a497b95
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:41:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:41:25 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] [req-c1a0a0ee-903d-473e-a087-75591bb65745] Created resource provider record via placement API for resource provider with UUID 51ff9dac-8442-4423-a757-45ab0a497b95 and name user.
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75206) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 21:41:25 user nova-compute[75206]: INFO nova.virt.libvirt.host [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] kernel doesn't support AMD SEV
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Libvirt baseline CPU <cpu>
Nov 29 21:41:25 user nova-compute[75206]:   <arch>x86_64</arch>
Nov 29 21:41:25 user nova-compute[75206]:   <model>Nehalem</model>
Nov 29 21:41:25 user nova-compute[75206]:   <vendor>Intel</vendor>
Nov 29 21:41:25 user nova-compute[75206]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 21:41:25 user nova-compute[75206]: </cpu>
Nov 29 21:41:25 user nova-compute[75206]:  {{(pid=75206) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Updated inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Updating resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 generation from 0 to 1 during operation: update_inventory {{(pid=75206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Updating resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 generation from 1 to 2 during operation: update_traits {{(pid=75206) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.service [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Creating RPC server for service compute {{(pid=75206) start /opt/stack/nova/nova/service.py:182}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.service [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] Join ServiceGroup membership for this service compute {{(pid=75206) start /opt/stack/nova/nova/service.py:199}}
Nov 29 21:41:25 user nova-compute[75206]: DEBUG nova.servicegroup.drivers.db [None req-e416f220-3a9d-4371-9c68-35ce1d7bb4fc None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75206) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 21:41:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:41:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:42:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:42:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=10441MB free_disk=25.966503143310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:42:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:43:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:43:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=10364MB free_disk=26.031574249267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:43:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:43:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:43:18 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:44:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:44:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=25.78549575805664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:44:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:44:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:44:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:45:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:45:17 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:17 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=9690MB free_disk=25.812583923339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:45:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:45:21 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:45:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:28 user nova-compute[75206]: INFO nova.compute.claims [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Claim successful on node user
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:28 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:28 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Creating image(s)
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "/opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "/opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "/opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG nova.policy [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c4c7e36918141ada3ee2176e53a01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9c55ac93d5431cb012db09148aebf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG nova.virt.images [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:45:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.part /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.part /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.converted" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.619s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:30 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7ovszhnm/privsep.sock']
Nov 29 21:45:30 user sudo[84508]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7ovszhnm/privsep.sock
Nov 29 21:45:30 user sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 21:45:30 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Successfully created port: 4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:45:31 user sudo[84508]: pam_unix(sudo:session): session closed for user root
Nov 29 21:45:31 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Spawned new privsep daemon via rootwrap
Nov 29 21:45:31 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 21:45:31 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 21:45:31 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 21:45:31 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84511
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.164s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk 1073741824" returned: 0 in 0.046s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Cannot resize image /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Ensure instance console log exists: /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Successfully updated port: 4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquired lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-changed-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Refreshing instance network info cache due to event network-changed-4143beb8-7fba-48e2-b60d-58820b4d5d85. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] Acquiring lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:34 user nova-compute[75206]: INFO nova.compute.claims [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Claim successful on node user
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating instance_info_cache with network_info: [{"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Releasing lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Instance network_info: |[{"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] Acquired lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Refreshing network info cache for port 4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Start _get_guest_xml network_info=[{"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:34 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:34 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1821517086',display_name='tempest-DeleteServersTestJSON-server-1821517086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1821517086',id=1,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9c55ac93d5431cb012db09148aebf2',ramdisk_id='',reservation_id='r-fblalfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-335161360',owner_user_name='tempest-DeleteServersTestJSON-335161360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:29Z,user_data=None,user_id='4c4c7e36918141ada3ee2176e53a01ec',uuid=46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converting VIF {"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lazy-loading 'pci_devices' on Instance uuid 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:45:34 user nova-compute[75206]:   <uuid>46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d</uuid>
Nov 29 21:45:34 user nova-compute[75206]:   <name>instance-00000001</name>
Nov 29 21:45:34 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:45:34 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:45:34 user nova-compute[75206]:   <metadata>
Nov 29 21:45:34 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:45:34 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:name>tempest-DeleteServersTestJSON-server-1821517086</nova:name>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:45:34</nova:creationTime>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:45:34 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:45:34 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:owner>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:user uuid="4c4c7e36918141ada3ee2176e53a01ec">tempest-DeleteServersTestJSON-335161360-project-member</nova:user>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:project uuid="9c9c55ac93d5431cb012db09148aebf2">tempest-DeleteServersTestJSON-335161360</nova:project>
Nov 29 21:45:34 user nova-compute[75206]:       </nova:owner>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:45:34 user nova-compute[75206]:       <nova:ports>
Nov 29 21:45:34 user nova-compute[75206]:         <nova:port uuid="4143beb8-7fba-48e2-b60d-58820b4d5d85">
Nov 29 21:45:34 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 21:45:34 user nova-compute[75206]:         </nova:port>
Nov 29 21:45:34 user nova-compute[75206]:       </nova:ports>
Nov 29 21:45:34 user nova-compute[75206]:     </nova:instance>
Nov 29 21:45:34 user nova-compute[75206]:   </metadata>
Nov 29 21:45:34 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:45:34 user nova-compute[75206]:     <system>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="serial">46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d</entry>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="uuid">46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d</entry>
Nov 29 21:45:34 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:45:34 user nova-compute[75206]:     </system>
Nov 29 21:45:34 user nova-compute[75206]:   </sysinfo>
Nov 29 21:45:34 user nova-compute[75206]:   <os>
Nov 29 21:45:34 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:45:34 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:45:34 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:45:34 user nova-compute[75206]:   </os>
Nov 29 21:45:34 user nova-compute[75206]:   <features>
Nov 29 21:45:34 user nova-compute[75206]:     <acpi/>
Nov 29 21:45:34 user nova-compute[75206]:     <apic/>
Nov 29 21:45:34 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:45:34 user nova-compute[75206]:   </features>
Nov 29 21:45:34 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:45:34 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:45:34 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:45:34 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:45:34 user nova-compute[75206]:   </clock>
Nov 29 21:45:34 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:45:34 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:45:34 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:45:34 user nova-compute[75206]:   </cpu>
Nov 29 21:45:34 user nova-compute[75206]:   <devices>
Nov 29 21:45:34 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:45:34 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:45:34 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk"/>
Nov 29 21:45:34 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:45:34 user nova-compute[75206]:     </disk>
Nov 29 21:45:34 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:45:34 user nova-compute[75206]:       <mac address="fa:16:3e:19:08:ce"/>
Nov 29 21:45:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:34 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:45:34 user nova-compute[75206]:       <target dev="tap4143beb8-7f"/>
Nov 29 21:45:34 user nova-compute[75206]:     </interface>
Nov 29 21:45:34 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:45:34 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/console.log" append="off"/>
Nov 29 21:45:34 user nova-compute[75206]:     </serial>
Nov 29 21:45:34 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:45:34 user nova-compute[75206]:     <video>
Nov 29 21:45:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:34 user nova-compute[75206]:     </video>
Nov 29 21:45:34 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:45:34 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:45:34 user nova-compute[75206]:     </rng>
Nov 29 21:45:34 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:45:34 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:45:34 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:45:34 user nova-compute[75206]:     </memballoon>
Nov 29 21:45:34 user nova-compute[75206]:   </devices>
Nov 29 21:45:34 user nova-compute[75206]: </domain>
Nov 29 21:45:34 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1821517086',display_name='tempest-DeleteServersTestJSON-server-1821517086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1821517086',id=1,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9c55ac93d5431cb012db09148aebf2',ramdisk_id='',reservation_id='r-fblalfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-335161360',owner_user_name='tempest-DeleteServersTestJSON-335161360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:29Z,user_data=None,user_id='4c4c7e36918141ada3ee2176e53a01ec',uuid=46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converting VIF {"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG os_vif [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Created schema index Interface.name {{(pid=75206) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Created schema index Port.name {{(pid=75206) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Created schema index Bridge.name {{(pid=75206) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [POLLOUT] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cb5d821-f6cf-561d-ac84-1777c4b591aa', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:34 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpflcrgdbb/privsep.sock']
Nov 29 21:45:34 user sudo[84538]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpflcrgdbb/privsep.sock
Nov 29 21:45:34 user sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.policy [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9befc13bc6ec4d6fb37d297c6927602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8009177c2d4cebaee3848aba1eeded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Creating image(s)
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "/opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk 1073741824" returned: 0 in 0.041s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Cannot resize image /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Ensure instance console log exists: /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updated VIF entry in instance network info cache for port 4143beb8-7fba-48e2-b60d-58820b4d5d85. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating instance_info_cache with network_info: [{"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40ccbadb-6dbc-4018-8b36-b6beb6d8b704 req-5286b932-c5ca-4567-aa7b-eab054195845 service nova] Releasing lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:36 user sudo[84538]: pam_unix(sudo:session): session closed for user root
Nov 29 21:45:36 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Spawned new privsep daemon via rootwrap
Nov 29 21:45:36 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 21:45:36 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 21:45:36 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 21:45:36 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84577
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4143beb8-7f, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4143beb8-7f, col_values=(('qos', UUID('99b822dd-89a7-4a35-8235-52e53114cf54')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4143beb8-7f, col_values=(('external_ids', {'iface-id': '4143beb8-7fba-48e2-b60d-58820b4d5d85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:08:ce', 'vm-uuid': '46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:36 user nova-compute[75206]: INFO os_vif [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f')
Nov 29 21:45:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:45:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] No VIF found with MAC fa:16:3e:19:08:ce, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:45:38 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Successfully created port: c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:45:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:45:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Instance spawned successfully.
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:40 user nova-compute[75206]: INFO nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Took 11.78 seconds to spawn the instance on the hypervisor.
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:45:40 user nova-compute[75206]: INFO nova.compute.manager [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Took 13.00 seconds to build instance.
Nov 29 21:45:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04a372b4-e588-4059-95a1-c5f2c7e32728 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.226s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Successfully updated port: c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquired lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-changed-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Refreshing instance network info cache due to event network-changed-c085e7e9-fc00-4ca3-ae80-78307b0175d5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] Acquiring lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Releasing lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Instance network_info: |[{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] Acquired lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Refreshing network info cache for port c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Start _get_guest_xml network_info=[{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:45:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1364712004',display_name='tempest-AttachVolumeNegativeTest-server-1364712004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1364712004',id=2,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd7PzjyYngXjpecWXu31NBenaaiyQKQqzRPM9Q8y4M85RJyF7qNyfYDDmQxoaLlddWiQDF2jIozrHHzj9KTU5mxnRZYPeyLHJVMHDnThzlDVJkk1Y5sADPY9O7RuSNuzQ==',key_name='tempest-keypair-1204995015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-gfetg9pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f343e212-3a5d-43e2-8b8b-81135caffb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'pci_devices' on Instance uuid f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:45:42 user nova-compute[75206]:   <uuid>f343e212-3a5d-43e2-8b8b-81135caffb2d</uuid>
Nov 29 21:45:42 user nova-compute[75206]:   <name>instance-00000002</name>
Nov 29 21:45:42 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:45:42 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:45:42 user nova-compute[75206]:   <metadata>
Nov 29 21:45:42 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:45:42 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1364712004</nova:name>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:45:42</nova:creationTime>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:45:42 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:45:42 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:owner>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:user uuid="9befc13bc6ec4d6fb37d297c6927602f">tempest-AttachVolumeNegativeTest-330553211-project-member</nova:user>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:project uuid="9e8009177c2d4cebaee3848aba1eeded">tempest-AttachVolumeNegativeTest-330553211</nova:project>
Nov 29 21:45:42 user nova-compute[75206]:       </nova:owner>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:45:42 user nova-compute[75206]:       <nova:ports>
Nov 29 21:45:42 user nova-compute[75206]:         <nova:port uuid="c085e7e9-fc00-4ca3-ae80-78307b0175d5">
Nov 29 21:45:42 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 21:45:42 user nova-compute[75206]:         </nova:port>
Nov 29 21:45:42 user nova-compute[75206]:       </nova:ports>
Nov 29 21:45:42 user nova-compute[75206]:     </nova:instance>
Nov 29 21:45:42 user nova-compute[75206]:   </metadata>
Nov 29 21:45:42 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:45:42 user nova-compute[75206]:     <system>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="serial">f343e212-3a5d-43e2-8b8b-81135caffb2d</entry>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="uuid">f343e212-3a5d-43e2-8b8b-81135caffb2d</entry>
Nov 29 21:45:42 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:45:42 user nova-compute[75206]:     </system>
Nov 29 21:45:42 user nova-compute[75206]:   </sysinfo>
Nov 29 21:45:42 user nova-compute[75206]:   <os>
Nov 29 21:45:42 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:45:42 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:45:42 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:45:42 user nova-compute[75206]:   </os>
Nov 29 21:45:42 user nova-compute[75206]:   <features>
Nov 29 21:45:42 user nova-compute[75206]:     <acpi/>
Nov 29 21:45:42 user nova-compute[75206]:     <apic/>
Nov 29 21:45:42 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:45:42 user nova-compute[75206]:   </features>
Nov 29 21:45:42 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:45:42 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:45:42 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:45:42 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:45:42 user nova-compute[75206]:   </clock>
Nov 29 21:45:42 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:45:42 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:45:42 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:45:42 user nova-compute[75206]:   </cpu>
Nov 29 21:45:42 user nova-compute[75206]:   <devices>
Nov 29 21:45:42 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:45:42 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:45:42 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk"/>
Nov 29 21:45:42 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:45:42 user nova-compute[75206]:     </disk>
Nov 29 21:45:42 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:45:42 user nova-compute[75206]:       <mac address="fa:16:3e:ba:5c:28"/>
Nov 29 21:45:42 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:42 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:45:42 user nova-compute[75206]:       <target dev="tapc085e7e9-fc"/>
Nov 29 21:45:42 user nova-compute[75206]:     </interface>
Nov 29 21:45:42 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:45:42 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/console.log" append="off"/>
Nov 29 21:45:42 user nova-compute[75206]:     </serial>
Nov 29 21:45:42 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:45:42 user nova-compute[75206]:     <video>
Nov 29 21:45:42 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:42 user nova-compute[75206]:     </video>
Nov 29 21:45:42 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:45:42 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:45:42 user nova-compute[75206]:     </rng>
Nov 29 21:45:42 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:45:42 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:45:42 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:45:42 user nova-compute[75206]:     </memballoon>
Nov 29 21:45:42 user nova-compute[75206]:   </devices>
Nov 29 21:45:42 user nova-compute[75206]: </domain>
Nov 29 21:45:42 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1364712004',display_name='tempest-AttachVolumeNegativeTest-server-1364712004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1364712004',id=2,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd7PzjyYngXjpecWXu31NBenaaiyQKQqzRPM9Q8y4M85RJyF7qNyfYDDmQxoaLlddWiQDF2jIozrHHzj9KTU5mxnRZYPeyLHJVMHDnThzlDVJkk1Y5sADPY9O7RuSNuzQ==',key_name='tempest-keypair-1204995015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-gfetg9pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f343e212-3a5d-43e2-8b8b-81135caffb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG os_vif [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9191f943-a558-58d4-a3f3-9363401396f2', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc085e7e9-fc, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc085e7e9-fc, col_values=(('qos', UUID('915d4c91-6d7e-4cd6-8510-3ba19abd4d83')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc085e7e9-fc, col_values=(('external_ids', {'iface-id': 'c085e7e9-fc00-4ca3-ae80-78307b0175d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5c:28', 'vm-uuid': 'f343e212-3a5d-43e2-8b8b-81135caffb2d'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:42 user nova-compute[75206]: INFO os_vif [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc')
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:45:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:ba:5c:28, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:45:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updated VIF entry in instance network info cache for port c085e7e9-fc00-4ca3-ae80-78307b0175d5. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:45:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e1d070d7-cb57-48eb-bcac-f62c6d618c8e req-387f37e6-1c62-4a2a-9e8a-785fbcb96200 service nova] Releasing lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] No waiting events found dispatching network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:45:46 user nova-compute[75206]: WARNING nova.compute.manager [req-799fd815-01fe-4698-a424-48a788d41717 req-3844aa89-35da-48bd-9e85-5d2e28d57ee3 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received unexpected event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 for instance with vm_state building and task_state spawning.
Nov 29 21:45:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:45:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Instance spawned successfully.
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:45:47 user nova-compute[75206]: INFO nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Took 12.61 seconds to spawn the instance on the hypervisor.
Nov 29 21:45:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:45:47 user nova-compute[75206]: INFO nova.compute.manager [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Took 13.64 seconds to build instance.
Nov 29 21:45:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3b1fd9c6-90ef-4c7f-b36b-e0694b7e432a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.829s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] No waiting events found dispatching network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:45:48 user nova-compute[75206]: WARNING nova.compute.manager [req-59fd7b2d-c1e5-4bf2-8a5b-cbcffdb6e55e req-d44dcfb2-2eb1-4ae5-999b-675180b093dd service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received unexpected event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 for instance with vm_state active and task_state None.
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:51 user nova-compute[75206]: INFO nova.compute.claims [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Claim successful on node user
Nov 29 21:45:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:51 user nova-compute[75206]: DEBUG nova.policy [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ffc43b6564041838634be86c274658d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4983deca1f0f40cf92f0d84ae5c9edc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Creating image(s)
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "/opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "/opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.217s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.231s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk 1073741824" returned: 0 in 0.055s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.230s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Cannot resize image /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Ensure instance console log exists: /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Successfully created port: afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:54 user nova-compute[75206]: INFO nova.compute.claims [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Claim successful on node user
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.298s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:54 user nova-compute[75206]: INFO nova.compute.claims [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Claim successful on node user
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.policy [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35c9d4e110194df38abc8f14b889bfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a62bab4355a485ba3863a0ad0314f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Creating image(s)
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.273s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.202s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Creating image(s)
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "/opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "/opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk 1073741824" returned: 0 in 0.066s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:45:55 user nova-compute[75206]: DEBUG nova.policy [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccb0b04641b4f4f9015d71880f819f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a50384dbfc4c9692fc3af13949e535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.257s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.302s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Successfully updated port: afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquired lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-changed-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Refreshing instance network info cache due to event network-changed-afd32a60-abd7-4862-9579-2ba297343b82. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] Acquiring lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Cannot resize image /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Ensure instance console log exists: /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:45:56 user nova-compute[75206]: INFO nova.compute.claims [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Claim successful on node user
Nov 29 21:45:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.236s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk 1073741824" returned: 0 in 0.101s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.213s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Cannot resize image /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Ensure instance console log exists: /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:45:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:45:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Creating image(s)
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating instance_info_cache with network_info: [{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Releasing lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Instance network_info: |[{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] Acquired lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Refreshing network info cache for port afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Start _get_guest_xml network_info=[{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:45:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1987196421',display_name='tempest-TestVolumeSwap-server-1987196421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1987196421',id=3,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5W6B7d+2GMNs69Jjn/hB/Izd0ElgB9F4jrY5okYZB9zd0i98dHtKAfrWGUHthxCitXKb1inG3390FOU3ilz6SCEJ5uyspR1+Yxv2ZiceeyJ/dR8NtJhXR948zV3KaXg==',key_name='tempest-keypair-494131810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4983deca1f0f40cf92f0d84ae5c9edc3',ramdisk_id='',reservation_id='r-6cj780mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1929009653',owner_user_name='tempest-TestVolumeSwap-1929009653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ffc43b6564041838634be86c274658d',uuid=6f335e0e-1ba6-428d-9aab-1f05d6ff18b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converting VIF {"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.policy [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6b1dbe668dd4f16801a8b19bcb3fc5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8e0f56957248c2b4e7b648c207dcab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:45:57 user nova-compute[75206]:   <uuid>6f335e0e-1ba6-428d-9aab-1f05d6ff18b0</uuid>
Nov 29 21:45:57 user nova-compute[75206]:   <name>instance-00000003</name>
Nov 29 21:45:57 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:45:57 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:45:57 user nova-compute[75206]:   <metadata>
Nov 29 21:45:57 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:45:57 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:name>tempest-TestVolumeSwap-server-1987196421</nova:name>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:45:57</nova:creationTime>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:45:57 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:45:57 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:owner>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:user uuid="2ffc43b6564041838634be86c274658d">tempest-TestVolumeSwap-1929009653-project-member</nova:user>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:project uuid="4983deca1f0f40cf92f0d84ae5c9edc3">tempest-TestVolumeSwap-1929009653</nova:project>
Nov 29 21:45:57 user nova-compute[75206]:       </nova:owner>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:45:57 user nova-compute[75206]:       <nova:ports>
Nov 29 21:45:57 user nova-compute[75206]:         <nova:port uuid="afd32a60-abd7-4862-9579-2ba297343b82">
Nov 29 21:45:57 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:45:57 user nova-compute[75206]:         </nova:port>
Nov 29 21:45:57 user nova-compute[75206]:       </nova:ports>
Nov 29 21:45:57 user nova-compute[75206]:     </nova:instance>
Nov 29 21:45:57 user nova-compute[75206]:   </metadata>
Nov 29 21:45:57 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:45:57 user nova-compute[75206]:     <system>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="serial">6f335e0e-1ba6-428d-9aab-1f05d6ff18b0</entry>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="uuid">6f335e0e-1ba6-428d-9aab-1f05d6ff18b0</entry>
Nov 29 21:45:57 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:45:57 user nova-compute[75206]:     </system>
Nov 29 21:45:57 user nova-compute[75206]:   </sysinfo>
Nov 29 21:45:57 user nova-compute[75206]:   <os>
Nov 29 21:45:57 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:45:57 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:45:57 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:45:57 user nova-compute[75206]:   </os>
Nov 29 21:45:57 user nova-compute[75206]:   <features>
Nov 29 21:45:57 user nova-compute[75206]:     <acpi/>
Nov 29 21:45:57 user nova-compute[75206]:     <apic/>
Nov 29 21:45:57 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:45:57 user nova-compute[75206]:   </features>
Nov 29 21:45:57 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:45:57 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:45:57 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:45:57 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:45:57 user nova-compute[75206]:   </clock>
Nov 29 21:45:57 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:45:57 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:45:57 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:45:57 user nova-compute[75206]:   </cpu>
Nov 29 21:45:57 user nova-compute[75206]:   <devices>
Nov 29 21:45:57 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:45:57 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:45:57 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk"/>
Nov 29 21:45:57 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:45:57 user nova-compute[75206]:     </disk>
Nov 29 21:45:57 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:45:57 user nova-compute[75206]:       <mac address="fa:16:3e:5c:99:67"/>
Nov 29 21:45:57 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:57 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:45:57 user nova-compute[75206]:       <target dev="tapafd32a60-ab"/>
Nov 29 21:45:57 user nova-compute[75206]:     </interface>
Nov 29 21:45:57 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:45:57 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/console.log" append="off"/>
Nov 29 21:45:57 user nova-compute[75206]:     </serial>
Nov 29 21:45:57 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:45:57 user nova-compute[75206]:     <video>
Nov 29 21:45:57 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:45:57 user nova-compute[75206]:     </video>
Nov 29 21:45:57 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:45:57 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:45:57 user nova-compute[75206]:     </rng>
Nov 29 21:45:57 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:45:57 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:45:57 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:45:57 user nova-compute[75206]:     </memballoon>
Nov 29 21:45:57 user nova-compute[75206]:   </devices>
Nov 29 21:45:57 user nova-compute[75206]: </domain>
Nov 29 21:45:57 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1987196421',display_name='tempest-TestVolumeSwap-server-1987196421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1987196421',id=3,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5W6B7d+2GMNs69Jjn/hB/Izd0ElgB9F4jrY5okYZB9zd0i98dHtKAfrWGUHthxCitXKb1inG3390FOU3ilz6SCEJ5uyspR1+Yxv2ZiceeyJ/dR8NtJhXR948zV3KaXg==',key_name='tempest-keypair-494131810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4983deca1f0f40cf92f0d84ae5c9edc3',ramdisk_id='',reservation_id='r-6cj780mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1929009653',owner_user_name='tempest-TestVolumeSwap-1929009653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ffc43b6564041838634be86c274658d',uuid=6f335e0e-1ba6-428d-9aab-1f05d6ff18b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converting VIF {"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG os_vif [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Successfully created port: f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Successfully created port: 33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da6ecfaf-0840-51af-9952-98bdef026647', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafd32a60-ab, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafd32a60-ab, col_values=(('qos', UUID('6978b692-a424-4492-b1c4-54536b65de0c')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafd32a60-ab, col_values=(('external_ids', {'iface-id': 'afd32a60-abd7-4862-9579-2ba297343b82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:99:67', 'vm-uuid': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:45:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:57 user nova-compute[75206]: INFO os_vif [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab')
Nov 29 21:45:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.part --force-share --output=json" returned: 0 in 0.358s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG nova.virt.images [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] ac67ac1c-c324-40f4-85cf-11f8ae86e502 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.part /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] No VIF found with MAC fa:16:3e:5c:99:67, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.part /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.converted" returned: 0 in 0.868s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.021s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3,backing_fmt=raw /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3,backing_fmt=raw /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk 1073741824" returned: 0 in 0.052s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b67a7a018931b2b29eb0d9aa38c57f7efc6915e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updated VIF entry in instance network info cache for port afd32a60-abd7-4862-9579-2ba297343b82. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating instance_info_cache with network_info: [{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11c2b0d6-f3b8-4dcf-b775-bdc0f02d4a1f req-e167ee64-978e-4ce8-8861-76c581570a82 service nova] Releasing lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:45:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Cannot resize image /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Ensure instance console log exists: /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Successfully updated port: f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-changed-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing instance network info cache due to event network-changed-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Successfully updated port: 33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquired lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-changed-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Refreshing instance network info cache due to event network-changed-33b2c974-f064-470a-b5b1-ea9a4de1fff1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] Acquiring lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Instance network_info: |[{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing network info cache for port f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Start _get_guest_xml network_info=[{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'pci_devices' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Successfully created port: a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:01 user nova-compute[75206]:   <uuid>852f5aba-96eb-44f4-869a-aa635b6ec7e2</uuid>
Nov 29 21:46:01 user nova-compute[75206]:   <name>instance-00000004</name>
Nov 29 21:46:01 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:01 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:01 user nova-compute[75206]:   <metadata>
Nov 29 21:46:01 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:01 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:01</nova:creationTime>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:01 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:46:01 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:46:01 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:01 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:01 user nova-compute[75206]:   </metadata>
Nov 29 21:46:01 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:01 user nova-compute[75206]:     <system>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="serial">852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="uuid">852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:01 user nova-compute[75206]:     </system>
Nov 29 21:46:01 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:01 user nova-compute[75206]:   <os>
Nov 29 21:46:01 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:01 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:01 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:01 user nova-compute[75206]:   </os>
Nov 29 21:46:01 user nova-compute[75206]:   <features>
Nov 29 21:46:01 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:01 user nova-compute[75206]:     <apic/>
Nov 29 21:46:01 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:01 user nova-compute[75206]:   </features>
Nov 29 21:46:01 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:01 user nova-compute[75206]:   </clock>
Nov 29 21:46:01 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:01 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:01 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:01 user nova-compute[75206]:   </cpu>
Nov 29 21:46:01 user nova-compute[75206]:   <devices>
Nov 29 21:46:01 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:01 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:01 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk"/>
Nov 29 21:46:01 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:     </disk>
Nov 29 21:46:01 user nova-compute[75206]:     <disk type="file" device="cdrom">
Nov 29 21:46:01 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 21:46:01 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config"/>
Nov 29 21:46:01 user nova-compute[75206]:       <target dev="hda" bus="ide"/>
Nov 29 21:46:01 user nova-compute[75206]:     </disk>
Nov 29 21:46:01 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:01 user nova-compute[75206]:       <mac address="fa:16:3e:e5:8b:14"/>
Nov 29 21:46:01 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:01 user nova-compute[75206]:       <target dev="tapf5c0d0f5-e1"/>
Nov 29 21:46:01 user nova-compute[75206]:     </interface>
Nov 29 21:46:01 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:01 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log" append="off"/>
Nov 29 21:46:01 user nova-compute[75206]:     </serial>
Nov 29 21:46:01 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:01 user nova-compute[75206]:     <video>
Nov 29 21:46:01 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:     </video>
Nov 29 21:46:01 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:01 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:01 user nova-compute[75206]:     </rng>
Nov 29 21:46:01 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:01 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:01 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:01 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:01 user nova-compute[75206]:   </devices>
Nov 29 21:46:01 user nova-compute[75206]: </domain>
Nov 29 21:46:01 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG os_vif [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eec70b9d-f169-51f9-bb08-dcde8c9ecb3c', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5c0d0f5-e1, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5c0d0f5-e1, col_values=(('qos', UUID('bc69ea17-2e9c-4ad4-9fff-1bbc2f5206a4')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5c0d0f5-e1, col_values=(('external_ids', {'iface-id': 'f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8b:14', 'vm-uuid': '852f5aba-96eb-44f4-869a-aa635b6ec7e2'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: INFO os_vif [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1')
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No VIF found with MAC fa:16:3e:e5:8b:14, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Using config drive
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating instance_info_cache with network_info: [{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Releasing lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Instance network_info: |[{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] Acquired lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Refreshing network info cache for port 33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Start _get_guest_xml network_info=[{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1014089528',display_name='tempest-VolumesAdminNegativeTest-server-1014089528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1014089528',id=5,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW90M18P5spDDAKwHEoFOJmuECGIDTTfW81v/q32Y7PoqAnuWF9XW+mOIcioLDb5didG8blGYYb1BMYH4tpG5vIJ9qUfuKXvVoEHgikFhp5LqLE8ek8A0xrpwqP2mrgug==',key_name='tempest-keypair-49467320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-x88o2akw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.objects.instance [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'pci_devices' on Instance uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:01 user nova-compute[75206]:   <uuid>ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd</uuid>
Nov 29 21:46:01 user nova-compute[75206]:   <name>instance-00000005</name>
Nov 29 21:46:01 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:01 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:01 user nova-compute[75206]:   <metadata>
Nov 29 21:46:01 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:01 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1014089528</nova:name>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:01</nova:creationTime>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:01 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:user uuid="7ccb0b04641b4f4f9015d71880f819f3">tempest-VolumesAdminNegativeTest-1427104861-project-member</nova:user>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:project uuid="c6a50384dbfc4c9692fc3af13949e535">tempest-VolumesAdminNegativeTest-1427104861</nova:project>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:46:01 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:01 user nova-compute[75206]:         <nova:port uuid="33b2c974-f064-470a-b5b1-ea9a4de1fff1">
Nov 29 21:46:01 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 21:46:01 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:01 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:01 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:01 user nova-compute[75206]:   </metadata>
Nov 29 21:46:01 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:01 user nova-compute[75206]:     <system>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="serial">ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="uuid">ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd</entry>
Nov 29 21:46:01 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:01 user nova-compute[75206]:     </system>
Nov 29 21:46:01 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:01 user nova-compute[75206]:   <os>
Nov 29 21:46:01 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:01 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:01 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:01 user nova-compute[75206]:   </os>
Nov 29 21:46:01 user nova-compute[75206]:   <features>
Nov 29 21:46:01 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:01 user nova-compute[75206]:     <apic/>
Nov 29 21:46:01 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:01 user nova-compute[75206]:   </features>
Nov 29 21:46:01 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:01 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:01 user nova-compute[75206]:   </clock>
Nov 29 21:46:01 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:01 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:01 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:01 user nova-compute[75206]:   </cpu>
Nov 29 21:46:01 user nova-compute[75206]:   <devices>
Nov 29 21:46:01 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:01 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:01 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk"/>
Nov 29 21:46:01 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:     </disk>
Nov 29 21:46:01 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:01 user nova-compute[75206]:       <mac address="fa:16:3e:4d:22:7f"/>
Nov 29 21:46:01 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:01 user nova-compute[75206]:       <target dev="tap33b2c974-f0"/>
Nov 29 21:46:01 user nova-compute[75206]:     </interface>
Nov 29 21:46:01 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:01 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/console.log" append="off"/>
Nov 29 21:46:01 user nova-compute[75206]:     </serial>
Nov 29 21:46:01 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:01 user nova-compute[75206]:     <video>
Nov 29 21:46:01 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:01 user nova-compute[75206]:     </video>
Nov 29 21:46:01 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:01 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:01 user nova-compute[75206]:     </rng>
Nov 29 21:46:01 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:01 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:01 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:01 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:01 user nova-compute[75206]:   </devices>
Nov 29 21:46:01 user nova-compute[75206]: </domain>
Nov 29 21:46:01 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1014089528',display_name='tempest-VolumesAdminNegativeTest-server-1014089528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1014089528',id=5,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW90M18P5spDDAKwHEoFOJmuECGIDTTfW81v/q32Y7PoqAnuWF9XW+mOIcioLDb5didG8blGYYb1BMYH4tpG5vIJ9qUfuKXvVoEHgikFhp5LqLE8ek8A0xrpwqP2mrgug==',key_name='tempest-keypair-49467320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-x88o2akw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG os_vif [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '680bdd80-1ab0-5a9a-9f94-26abb262ed23', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33b2c974-f0, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33b2c974-f0, col_values=(('qos', UUID('fe1e0992-272a-4a13-b8df-6416610d6e1e')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33b2c974-f0, col_values=(('external_ids', {'iface-id': '33b2c974-f064-470a-b5b1-ea9a4de1fff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:22:7f', 'vm-uuid': 'ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:01 user nova-compute[75206]: INFO os_vif [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0')
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No VIF found with MAC fa:16:3e:4d:22:7f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updated VIF entry in instance network info cache for port f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3a29555f-662a-4b66-bef5-762ff36eef0b req-c9b1169a-8871-42ef-9a76-9daa2a459034 service nova] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Creating config drive at /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config
Nov 29 21:46:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp695hjgso {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp695hjgso" returned: 0 in 0.077s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Instance spawned successfully.
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:02 user nova-compute[75206]: INFO nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Took 10.67 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:02 user nova-compute[75206]: INFO nova.compute.manager [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Took 11.66 seconds to build instance.
Nov 29 21:46:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c7a781d3-7d1d-4de4-b1b0-5995889fe903 tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.822s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updated VIF entry in instance network info cache for port 33b2c974-f064-470a-b5b1-ea9a4de1fff1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating instance_info_cache with network_info: [{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f42204fd-76ea-498d-aeb0-e61bcff9c552 req-ed1a3a37-7553-477d-a9e6-72d739a3df3b service nova] Releasing lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Successfully updated port: a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquired lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-changed-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Refreshing instance network info cache due to event network-changed-a3889f06-a7d3-4fb9-ac39-2338a5e175d4. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] Acquiring lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:04 user nova-compute[75206]: INFO nova.compute.claims [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Claim successful on node user
Nov 29 21:46:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating instance_info_cache with network_info: [{"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Releasing lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Instance network_info: |[{"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] Acquired lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.neutron [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Refreshing network info cache for port a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Start _get_guest_xml network_info=[{"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:45:46Z,direct_url=<?>,disk_format='qcow2',id=ac67ac1c-c324-40f4-85cf-11f8ae86e502,min_disk=0,min_ram=0,name='',owner='5f89c5b272954a27822a59147303c470',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:45:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': 'ac67ac1c-c324-40f4-85cf-11f8ae86e502'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:45:46Z,direct_url=<?>,disk_format='qcow2',id=ac67ac1c-c324-40f4-85cf-11f8ae86e502,min_disk=0,min_ram=0,name='',owner='5f89c5b272954a27822a59147303c470',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:45:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-462603799',display_name='tempest-AttachSCSIVolumeTestJSON-server-462603799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-462603799',id=6,image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4wXi47ahEh75OpMFnFRGsTGREey9q49VK7np4/Ke3PySHP7IRyUuwFVigKvq17vGagrs4eH1De0yID7P0bDM+tJLRm31uHrEpi7c7zJHu/W/xEuL30ci8a1vOVwFJKGA==',key_name='tempest-keypair-1368523522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba8e0f56957248c2b4e7b648c207dcab',ramdisk_id='',reservation_id='r-1c44ng8s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1815242500',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1815242500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6b1dbe668dd4f16801a8b19bcb3fc5b',uuid=b591b5dc-f459-4071-bc2a-277610d97ecc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converting VIF {"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lazy-loading 'pci_devices' on Instance uuid b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:05 user nova-compute[75206]:   <uuid>b591b5dc-f459-4071-bc2a-277610d97ecc</uuid>
Nov 29 21:46:05 user nova-compute[75206]:   <name>instance-00000006</name>
Nov 29 21:46:05 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:05 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:05 user nova-compute[75206]:   <metadata>
Nov 29 21:46:05 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:05 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-462603799</nova:name>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:05</nova:creationTime>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:05 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:05 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:user uuid="a6b1dbe668dd4f16801a8b19bcb3fc5b">tempest-AttachSCSIVolumeTestJSON-1815242500-project-member</nova:user>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:project uuid="ba8e0f56957248c2b4e7b648c207dcab">tempest-AttachSCSIVolumeTestJSON-1815242500</nova:project>
Nov 29 21:46:05 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:root type="image" uuid="ac67ac1c-c324-40f4-85cf-11f8ae86e502"/>
Nov 29 21:46:05 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:05 user nova-compute[75206]:         <nova:port uuid="a3889f06-a7d3-4fb9-ac39-2338a5e175d4">
Nov 29 21:46:05 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 21:46:05 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:05 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:05 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:05 user nova-compute[75206]:   </metadata>
Nov 29 21:46:05 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:05 user nova-compute[75206]:     <system>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="serial">b591b5dc-f459-4071-bc2a-277610d97ecc</entry>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="uuid">b591b5dc-f459-4071-bc2a-277610d97ecc</entry>
Nov 29 21:46:05 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:05 user nova-compute[75206]:     </system>
Nov 29 21:46:05 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:05 user nova-compute[75206]:   <os>
Nov 29 21:46:05 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:05 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:05 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:05 user nova-compute[75206]:   </os>
Nov 29 21:46:05 user nova-compute[75206]:   <features>
Nov 29 21:46:05 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:05 user nova-compute[75206]:     <apic/>
Nov 29 21:46:05 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:05 user nova-compute[75206]:   </features>
Nov 29 21:46:05 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:05 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:05 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:05 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:05 user nova-compute[75206]:   </clock>
Nov 29 21:46:05 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:05 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:05 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:05 user nova-compute[75206]:   </cpu>
Nov 29 21:46:05 user nova-compute[75206]:   <devices>
Nov 29 21:46:05 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:05 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:05 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk"/>
Nov 29 21:46:05 user nova-compute[75206]:       <target dev="sda" bus="scsi"/>
Nov 29 21:46:05 user nova-compute[75206]:       <address type="drive" controller="0" unit="0"/>
Nov 29 21:46:05 user nova-compute[75206]:     </disk>
Nov 29 21:46:05 user nova-compute[75206]:     <disk type="file" device="cdrom">
Nov 29 21:46:05 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 21:46:05 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.config"/>
Nov 29 21:46:05 user nova-compute[75206]:       <target dev="sdb" bus="scsi"/>
Nov 29 21:46:05 user nova-compute[75206]:       <address type="drive" controller="0" unit="1"/>
Nov 29 21:46:05 user nova-compute[75206]:     </disk>
Nov 29 21:46:05 user nova-compute[75206]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 21:46:05 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:05 user nova-compute[75206]:       <mac address="fa:16:3e:09:ee:f5"/>
Nov 29 21:46:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:05 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:05 user nova-compute[75206]:       <target dev="tapa3889f06-a7"/>
Nov 29 21:46:05 user nova-compute[75206]:     </interface>
Nov 29 21:46:05 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:05 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/console.log" append="off"/>
Nov 29 21:46:05 user nova-compute[75206]:     </serial>
Nov 29 21:46:05 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:05 user nova-compute[75206]:     <video>
Nov 29 21:46:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:05 user nova-compute[75206]:     </video>
Nov 29 21:46:05 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:05 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:05 user nova-compute[75206]:     </rng>
Nov 29 21:46:05 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:05 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:05 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:05 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:05 user nova-compute[75206]:   </devices>
Nov 29 21:46:05 user nova-compute[75206]: </domain>
Nov 29 21:46:05 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-462603799',display_name='tempest-AttachSCSIVolumeTestJSON-server-462603799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-462603799',id=6,image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4wXi47ahEh75OpMFnFRGsTGREey9q49VK7np4/Ke3PySHP7IRyUuwFVigKvq17vGagrs4eH1De0yID7P0bDM+tJLRm31uHrEpi7c7zJHu/W/xEuL30ci8a1vOVwFJKGA==',key_name='tempest-keypair-1368523522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba8e0f56957248c2b4e7b648c207dcab',ramdisk_id='',reservation_id='r-1c44ng8s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1815242500',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1815242500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6b1dbe668dd4f16801a8b19bcb3fc5b',uuid=b591b5dc-f459-4071-bc2a-277610d97ecc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converting VIF {"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG os_vif [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2fbdc91-2f17-5a14-ab5f-b51f4873358f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3889f06-a7, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3889f06-a7, col_values=(('qos', UUID('0b40b0b9-83ee-47fa-a78c-cc75f510bb05')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3889f06-a7, col_values=(('external_ids', {'iface-id': 'a3889f06-a7d3-4fb9-ac39-2338a5e175d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:ee:f5', 'vm-uuid': 'b591b5dc-f459-4071-bc2a-277610d97ecc'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: INFO os_vif [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7')
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.policy [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0e5aeaa21d7401eb7aa308f258ba9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a2d0b7649174bcc950c52daf296b504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No BDM found with device name sda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No VIF found with MAC fa:16:3e:09:ee:f5, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Using config drive
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:46:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Creating image(s)
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "/opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "/opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "/opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Creating config drive at /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.config
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprn4tahsp {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.300s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprn4tahsp" returned: 0 in 0.109s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.network.neutron [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updated VIF entry in instance network info cache for port a3889f06-a7d3-4fb9-ac39-2338a5e175d4. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.network.neutron [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating instance_info_cache with network_info: [{"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.272s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d88adcf-1e0a-47ff-a88b-df9dced18f83 req-695cc2df-fa6a-4f8c-8fcc-c111ebfbe034 service nova] Releasing lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk 1073741824" returned: 0 in 0.088s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.263s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Successfully created port: a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Cannot resize image /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Ensure instance console log exists: /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Successfully updated port: a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquired lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-changed-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Refreshing instance network info cache due to event network-changed-a4337e1c-bf33-4222-8048-13eea520609b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] Acquiring lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Instance spawned successfully.
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Instance spawned successfully.
Nov 29 21:46:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Updating instance_info_cache with network_info: [{"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Releasing lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Instance network_info: |[{"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] Acquired lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Refreshing network info cache for port a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Start _get_guest_xml network_info=[{"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:08 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:08 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1898519636',display_name='tempest-VolumesActionsTest-instance-1898519636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1898519636',id=7,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-r3wr2bni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:05Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=83c0ed70-6d8b-4c56-a3b2-907681b11f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lazy-loading 'pci_devices' on Instance uuid 83c0ed70-6d8b-4c56-a3b2-907681b11f8b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:08 user nova-compute[75206]: INFO nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Took 12.99 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:08 user nova-compute[75206]: INFO nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Took 12.45 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:08 user nova-compute[75206]:   <uuid>83c0ed70-6d8b-4c56-a3b2-907681b11f8b</uuid>
Nov 29 21:46:08 user nova-compute[75206]:   <name>instance-00000007</name>
Nov 29 21:46:08 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:08 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:08 user nova-compute[75206]:   <metadata>
Nov 29 21:46:08 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:08 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:name>tempest-VolumesActionsTest-instance-1898519636</nova:name>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:08</nova:creationTime>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:08 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:08 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:user uuid="c0e5aeaa21d7401eb7aa308f258ba9b5">tempest-VolumesActionsTest-1514528984-project-member</nova:user>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:project uuid="3a2d0b7649174bcc950c52daf296b504">tempest-VolumesActionsTest-1514528984</nova:project>
Nov 29 21:46:08 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:46:08 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:08 user nova-compute[75206]:         <nova:port uuid="a4337e1c-bf33-4222-8048-13eea520609b">
Nov 29 21:46:08 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 21:46:08 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:08 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:08 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:08 user nova-compute[75206]:   </metadata>
Nov 29 21:46:08 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:08 user nova-compute[75206]:     <system>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="serial">83c0ed70-6d8b-4c56-a3b2-907681b11f8b</entry>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="uuid">83c0ed70-6d8b-4c56-a3b2-907681b11f8b</entry>
Nov 29 21:46:08 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:08 user nova-compute[75206]:     </system>
Nov 29 21:46:08 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:08 user nova-compute[75206]:   <os>
Nov 29 21:46:08 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:08 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:08 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:08 user nova-compute[75206]:   </os>
Nov 29 21:46:08 user nova-compute[75206]:   <features>
Nov 29 21:46:08 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:08 user nova-compute[75206]:     <apic/>
Nov 29 21:46:08 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:08 user nova-compute[75206]:   </features>
Nov 29 21:46:08 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:08 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:08 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:08 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:08 user nova-compute[75206]:   </clock>
Nov 29 21:46:08 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:08 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:08 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:08 user nova-compute[75206]:   </cpu>
Nov 29 21:46:08 user nova-compute[75206]:   <devices>
Nov 29 21:46:08 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:08 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:08 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk"/>
Nov 29 21:46:08 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:08 user nova-compute[75206]:     </disk>
Nov 29 21:46:08 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:08 user nova-compute[75206]:       <mac address="fa:16:3e:0a:c9:34"/>
Nov 29 21:46:08 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:08 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:08 user nova-compute[75206]:       <target dev="tapa4337e1c-bf"/>
Nov 29 21:46:08 user nova-compute[75206]:     </interface>
Nov 29 21:46:08 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:08 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/console.log" append="off"/>
Nov 29 21:46:08 user nova-compute[75206]:     </serial>
Nov 29 21:46:08 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:08 user nova-compute[75206]:     <video>
Nov 29 21:46:08 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:08 user nova-compute[75206]:     </video>
Nov 29 21:46:08 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:08 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:08 user nova-compute[75206]:     </rng>
Nov 29 21:46:08 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:08 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:08 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:08 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:08 user nova-compute[75206]:   </devices>
Nov 29 21:46:08 user nova-compute[75206]: </domain>
Nov 29 21:46:08 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1898519636',display_name='tempest-VolumesActionsTest-instance-1898519636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1898519636',id=7,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-r3wr2bni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:05Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=83c0ed70-6d8b-4c56-a3b2-907681b11f8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG os_vif [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96847bbf-c8fd-5aca-8b3b-44cc31a2d8e4', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4337e1c-bf, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4337e1c-bf, col_values=(('qos', UUID('79c1dea0-b2a7-4234-919a-10b8d6fae669')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4337e1c-bf, col_values=(('external_ids', {'iface-id': 'a4337e1c-bf33-4222-8048-13eea520609b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:c9:34', 'vm-uuid': '83c0ed70-6d8b-4c56-a3b2-907681b11f8b'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: INFO os_vif [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf')
Nov 29 21:46:08 user nova-compute[75206]: INFO nova.compute.manager [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Took 14.17 seconds to build instance.
Nov 29 21:46:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be0aae31-3c50-4f33-a0f3-a2c088412e58 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.320s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] No VIF found with MAC fa:16:3e:0a:c9:34, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:08 user nova-compute[75206]: INFO nova.compute.manager [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Took 13.94 seconds to build instance.
Nov 29 21:46:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-71b52ef8-f197-4b05-8b32-892e50b91de4 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.068s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Updated VIF entry in instance network info cache for port a4337e1c-bf33-4222-8048-13eea520609b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Updating instance_info_cache with network_info: [{"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-00663d91-7552-416f-b7cc-c44b8d9826c5 req-0444ee3e-8991-4d90-bb75-ff2b99f02af8 service nova] Releasing lock "refresh_cache-83c0ed70-6d8b-4c56-a3b2-907681b11f8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] No waiting events found dispatching network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:10 user nova-compute[75206]: WARNING nova.compute.manager [req-2030e795-b608-4b91-a2d6-b117fbc6614c req-561cfdad-5ba4-4f96-8551-2a43b6c002d5 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received unexpected event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 for instance with vm_state active and task_state None.
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Instance spawned successfully.
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:10 user nova-compute[75206]: INFO nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Took 13.81 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:11 user nova-compute[75206]: INFO nova.compute.manager [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Took 15.13 seconds to build instance.
Nov 29 21:46:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-218b51b7-3a64-499b-8d43-98898b1fc32f tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.354s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:11 user nova-compute[75206]: INFO nova.compute.claims [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Claim successful on node user
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.policy [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da48168ea4546eaa9483e9a0f6b58ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26d008bca3f425595a0efccfc941dce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.021s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] No waiting events found dispatching network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:12 user nova-compute[75206]: WARNING nova.compute.manager [req-ed0a92ca-1efe-4f77-87eb-1e20d1e89583 req-89465156-1e00-45de-b493-494af51920e9 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received unexpected event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 for instance with vm_state active and task_state None.
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:46:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Creating image(s)
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "/opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "/opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "/opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:12 user nova-compute[75206]: WARNING nova.compute.manager [req-fe6eda01-e94a-4e65-93f8-e531a68c49bc req-a6f6b084-d16d-4139-8710-e639e8791b67 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 for instance with vm_state active and task_state None.
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] No waiting events found dispatching network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:12 user nova-compute[75206]: WARNING nova.compute.manager [req-27933af5-ed27-45eb-b779-3c27063fca94 req-77b2503b-9720-4946-9675-260c1186e4ca service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received unexpected event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 for instance with vm_state active and task_state None.
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:13 user nova-compute[75206]: INFO nova.compute.claims [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Claim successful on node user
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.268s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Instance spawned successfully.
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.257s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk 1073741824" returned: 0 in 0.089s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:13 user nova-compute[75206]: INFO nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.276s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:13 user nova-compute[75206]: INFO nova.compute.manager [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Took 9.26 seconds to build instance.
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cf3644b6-5cf6-4109-a18e-2a876a4ad019 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.419s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Successfully created port: 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Cannot resize image /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Ensure instance console log exists: /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:13 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.191s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:14 user nova-compute[75206]: DEBUG nova.policy [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf037e0205444fdb984ea545d1e323ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca012700c6b4badb992b35e8a80ca0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:14 user nova-compute[75206]: INFO nova.virt.block_device [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Booting with volume 28e66982-2444-45e3-bd55-0bd94990ca4a at /dev/vda
Nov 29 21:46:14 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:14 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwj0cq7xn/privsep.sock']
Nov 29 21:46:14 user sudo[85651]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwj0cq7xn/privsep.sock
Nov 29 21:46:14 user sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] No waiting events found dispatching network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:15 user nova-compute[75206]: WARNING nova.compute.manager [req-569097a2-dc08-4bab-9be0-e7c22959f846 req-48ab3de0-6cc9-4d64-9aee-6c5665aa510b service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received unexpected event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 for instance with vm_state active and task_state None.
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:15 user nova-compute[75206]: WARNING nova.compute.manager [req-927b9cba-4b98-44ea-9c93-06fec294ec9e req-b5767798-ca19-40af-a0c2-80faf8f23725 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 for instance with vm_state active and task_state None.
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Successfully updated port: 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquired lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-changed-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Refreshing instance network info cache due to event network-changed-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] Acquiring lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updating instance_info_cache with network_info: [{"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Releasing lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Instance network_info: |[{"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] Acquired lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.neutron [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Refreshing network info cache for port 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Start _get_guest_xml network_info=[{"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 21:46:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-116418356',display_name='tempest-VolumesAssistedSnapshotsTest-server-116418356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-116418356',id=8,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIprqftMJKt/hZ4UNylqrVH83JLPfSgjzz57qUO9kIbmWaJlO4xOL0UzBznIUSr74B0zw0ObaqnoigD4aOrUhB9bS/v3rHqt9dxqlzDHwotWRYAUKOuixZLtNjwshc+Ysw==',key_name='tempest-keypair-1675370620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e26d008bca3f425595a0efccfc941dce',ramdisk_id='',reservation_id='r-khgwfri9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1437458539',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1437458539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da48168ea4546eaa9483e9a0f6b58ee',uuid=94d891d6-a9e7-464e-b2d3-d829ba5cff8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converting VIF {"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lazy-loading 'pci_devices' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Successfully created port: e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:16 user nova-compute[75206]:   <uuid>94d891d6-a9e7-464e-b2d3-d829ba5cff8e</uuid>
Nov 29 21:46:16 user nova-compute[75206]:   <name>instance-00000008</name>
Nov 29 21:46:16 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:16 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:16 user nova-compute[75206]:   <metadata>
Nov 29 21:46:16 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:16 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-116418356</nova:name>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:16</nova:creationTime>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:16 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:16 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:user uuid="1da48168ea4546eaa9483e9a0f6b58ee">tempest-VolumesAssistedSnapshotsTest-1437458539-project-member</nova:user>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:project uuid="e26d008bca3f425595a0efccfc941dce">tempest-VolumesAssistedSnapshotsTest-1437458539</nova:project>
Nov 29 21:46:16 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:46:16 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:16 user nova-compute[75206]:         <nova:port uuid="457b41c0-a6b8-4e4b-95b3-ce0ace84edc5">
Nov 29 21:46:16 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 21:46:16 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:16 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:16 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:16 user nova-compute[75206]:   </metadata>
Nov 29 21:46:16 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:16 user nova-compute[75206]:     <system>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="serial">94d891d6-a9e7-464e-b2d3-d829ba5cff8e</entry>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="uuid">94d891d6-a9e7-464e-b2d3-d829ba5cff8e</entry>
Nov 29 21:46:16 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:16 user nova-compute[75206]:     </system>
Nov 29 21:46:16 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:16 user nova-compute[75206]:   <os>
Nov 29 21:46:16 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:16 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:16 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:16 user nova-compute[75206]:   </os>
Nov 29 21:46:16 user nova-compute[75206]:   <features>
Nov 29 21:46:16 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:16 user nova-compute[75206]:     <apic/>
Nov 29 21:46:16 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:16 user nova-compute[75206]:   </features>
Nov 29 21:46:16 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:16 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:16 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:16 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:16 user nova-compute[75206]:   </clock>
Nov 29 21:46:16 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:16 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:16 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:16 user nova-compute[75206]:   </cpu>
Nov 29 21:46:16 user nova-compute[75206]:   <devices>
Nov 29 21:46:16 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:16 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:16 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk"/>
Nov 29 21:46:16 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:16 user nova-compute[75206]:     </disk>
Nov 29 21:46:16 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:16 user nova-compute[75206]:       <mac address="fa:16:3e:11:8d:bd"/>
Nov 29 21:46:16 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:16 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:16 user nova-compute[75206]:       <target dev="tap457b41c0-a6"/>
Nov 29 21:46:16 user nova-compute[75206]:     </interface>
Nov 29 21:46:16 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:16 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/console.log" append="off"/>
Nov 29 21:46:16 user nova-compute[75206]:     </serial>
Nov 29 21:46:16 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:16 user nova-compute[75206]:     <video>
Nov 29 21:46:16 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:16 user nova-compute[75206]:     </video>
Nov 29 21:46:16 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:16 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:16 user nova-compute[75206]:     </rng>
Nov 29 21:46:16 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:16 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:16 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:16 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:16 user nova-compute[75206]:   </devices>
Nov 29 21:46:16 user nova-compute[75206]: </domain>
Nov 29 21:46:16 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-116418356',display_name='tempest-VolumesAssistedSnapshotsTest-server-116418356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-116418356',id=8,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIprqftMJKt/hZ4UNylqrVH83JLPfSgjzz57qUO9kIbmWaJlO4xOL0UzBznIUSr74B0zw0ObaqnoigD4aOrUhB9bS/v3rHqt9dxqlzDHwotWRYAUKOuixZLtNjwshc+Ysw==',key_name='tempest-keypair-1675370620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e26d008bca3f425595a0efccfc941dce',ramdisk_id='',reservation_id='r-khgwfri9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1437458539',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1437458539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da48168ea4546eaa9483e9a0f6b58ee',uuid=94d891d6-a9e7-464e-b2d3-d829ba5cff8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converting VIF {"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG os_vif [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '491dd001-f562-5e40-87cc-d6d6422d79f3', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457b41c0-a6, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457b41c0-a6, col_values=(('qos', UUID('0395ebc6-69fd-44a1-ac6f-279d1b84aa9a')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457b41c0-a6, col_values=(('external_ids', {'iface-id': '457b41c0-a6b8-4e4b-95b3-ce0ace84edc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8d:bd', 'vm-uuid': '94d891d6-a9e7-464e-b2d3-d829ba5cff8e'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: INFO os_vif [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6')
Nov 29 21:46:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] No VIF found with MAC fa:16:3e:11:8d:bd, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:16 user sudo[85651]: pam_unix(sudo:session): session closed for user root
Nov 29 21:46:16 user nova-compute[75206]: INFO oslo.privsep.daemon [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Spawned new privsep daemon via rootwrap
Nov 29 21:46:16 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 21:46:16 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 21:46:16 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 21:46:16 user nova-compute[75206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85661
Nov 29 21:46:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6ae72-dd44-40ca-9586-18197d5b9bf0]: (2,) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc9f77-64b7-4192-91bd-cdff6b41d421]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: WARNING os_brick.initiator.connectors.nvmeof [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda88d2-0769-4617-9160-4bdc89d382d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5b938-54de-4488-a05d-29a07ad0dbc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16a84da-ae6f-4c1d-a1bd-e34c348c7d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Successfully updated port: e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:17 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c721efaa-cefd-47b5-9dff-7a93cb901516]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] <== get_connector_properties: return (2573ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating existing volume attachment record: c7b4f3b1-a18d-4174-934b-3099efe99a27 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquired lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-changed-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Refreshing instance network info cache due to event network-changed-e1a603d4-d84b-4f30-8419-1c72d68dc14c. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] Acquiring lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updated VIF entry in instance network info cache for port 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updating instance_info_cache with network_info: [{"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating instance_info_cache with network_info: [{"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-baa48cd8-7e42-4a6c-9ed5-529d181440ce req-28a8fd1f-cc4f-4eba-9d86-0faefe043ceb service nova] Releasing lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Releasing lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance network_info: |[{"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] Acquired lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Refreshing network info cache for port e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updated VIF entry in instance network info cache for port e1a603d4-d84b-4f30-8419-1c72d68dc14c. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG nova.network.neutron [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating instance_info_cache with network_info: [{"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04d52a58-cbc7-4cff-b3d3-411f71ca6642 req-e45a5929-7208-4d56-b548-b142c5ae7acf service nova] Releasing lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] No waiting events found dispatching network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:19 user nova-compute[75206]: WARNING nova.compute.manager [req-1f3ad139-2d85-48e6-897f-6dcd6249807b req-8698e7b1-4308-4d21-857a-f674fe2bd313 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received unexpected event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 for instance with vm_state building and task_state spawning.
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Instance spawned successfully.
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:21 user nova-compute[75206]: INFO nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Took 8.32 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] No waiting events found dispatching network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:21 user nova-compute[75206]: WARNING nova.compute.manager [req-ec9511c6-68b3-4cf7-b25d-09d64ff3d5d9 req-2931ce19-d8b8-4c56-bade-471149655a1f service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received unexpected event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 for instance with vm_state active and task_state None.
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:21 user nova-compute[75206]: INFO nova.compute.manager [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Took 9.72 seconds to build instance.
Nov 29 21:46:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3650ccbd-244a-499a-ba22-bd0fd95cbd0f tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.900s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.438s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] No waiting events found dispatching network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:21 user nova-compute[75206]: WARNING nova.compute.manager [req-1c9fcb3c-8696-4788-8989-812182fe4ed6 req-c98766b6-7018-4a09-84bc-acf0394fa910 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received unexpected event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 for instance with vm_state active and task_state None.
Nov 29 21:46:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:22 user nova-compute[75206]: INFO nova.compute.claims [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Claim successful on node user
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] No waiting events found dispatching network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received unexpected event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 for instance with vm_state active and task_state None.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] No waiting events found dispatching network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received unexpected event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 for instance with vm_state active and task_state None.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] No waiting events found dispatching network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received unexpected event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 for instance with vm_state active and task_state None.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] No waiting events found dispatching network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received unexpected event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b for instance with vm_state active and task_state None.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] No waiting events found dispatching network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.compute.manager [req-e2256608-1ec8-4336-8067-74555f88f394 req-0c169faf-86fd-47c3-843b-77833f72f675 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received unexpected event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b for instance with vm_state active and task_state None.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.policy [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc10cde1c0834ba39ca989d7ebafae93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f811cf51c4aecbbd7cf1ddcc86ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Successfully created port: 8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:46:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Creating image(s)
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "/opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "/opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "/opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:23 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.611289978027344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.266s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b591b5dc-f459-4071-bc2a-277610d97ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 83c0ed70-6d8b-4c56-a3b2-907681b11f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 10941f43-65df-44a1-8c6d-22a8ef71bcff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.203s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk 1073741824" returned: 0 in 0.076s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Successfully updated port: 8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquired lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-changed-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Refreshing instance network info cache due to event network-changed-8666e24f-b9da-4b2e-80e5-b5e58d7b6728. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] Acquiring lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.236s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:24 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Cannot resize image /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Ensure instance console log exists: /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.096s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Updating instance_info_cache with network_info: [{"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Releasing lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Instance network_info: |[{"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] Acquired lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Refreshing network info cache for port 8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Start _get_guest_xml network_info=[{"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1274081142',display_name='tempest-VolumesActionsTest-instance-1274081142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1274081142',id=10,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e43f811cf51c4aecbbd7cf1ddcc86ae6',ramdisk_id='',reservation_id='r-dxexybqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1393828904',owner_user_name='tempest-VolumesActionsTest-1393828904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:23Z,user_data=None,user_id='cc10cde1c0834ba39ca989d7ebafae93',uuid=10941f43-65df-44a1-8c6d-22a8ef71bcff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converting VIF {"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lazy-loading 'pci_devices' on Instance uuid 10941f43-65df-44a1-8c6d-22a8ef71bcff {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:25 user nova-compute[75206]:   <uuid>10941f43-65df-44a1-8c6d-22a8ef71bcff</uuid>
Nov 29 21:46:25 user nova-compute[75206]:   <name>instance-0000000a</name>
Nov 29 21:46:25 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:25 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:25 user nova-compute[75206]:   <metadata>
Nov 29 21:46:25 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:25 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:name>tempest-VolumesActionsTest-instance-1274081142</nova:name>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:25</nova:creationTime>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:25 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:25 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:user uuid="cc10cde1c0834ba39ca989d7ebafae93">tempest-VolumesActionsTest-1393828904-project-member</nova:user>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:project uuid="e43f811cf51c4aecbbd7cf1ddcc86ae6">tempest-VolumesActionsTest-1393828904</nova:project>
Nov 29 21:46:25 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:46:25 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:25 user nova-compute[75206]:         <nova:port uuid="8666e24f-b9da-4b2e-80e5-b5e58d7b6728">
Nov 29 21:46:25 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 21:46:25 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:25 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:25 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:25 user nova-compute[75206]:   </metadata>
Nov 29 21:46:25 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:25 user nova-compute[75206]:     <system>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="serial">10941f43-65df-44a1-8c6d-22a8ef71bcff</entry>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="uuid">10941f43-65df-44a1-8c6d-22a8ef71bcff</entry>
Nov 29 21:46:25 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:25 user nova-compute[75206]:     </system>
Nov 29 21:46:25 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:25 user nova-compute[75206]:   <os>
Nov 29 21:46:25 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:25 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:25 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:25 user nova-compute[75206]:   </os>
Nov 29 21:46:25 user nova-compute[75206]:   <features>
Nov 29 21:46:25 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:25 user nova-compute[75206]:     <apic/>
Nov 29 21:46:25 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:25 user nova-compute[75206]:   </features>
Nov 29 21:46:25 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:25 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:25 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:25 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:25 user nova-compute[75206]:   </clock>
Nov 29 21:46:25 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:25 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:25 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:25 user nova-compute[75206]:   </cpu>
Nov 29 21:46:25 user nova-compute[75206]:   <devices>
Nov 29 21:46:25 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:46:25 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:46:25 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk"/>
Nov 29 21:46:25 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:25 user nova-compute[75206]:     </disk>
Nov 29 21:46:25 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:25 user nova-compute[75206]:       <mac address="fa:16:3e:7d:c5:1b"/>
Nov 29 21:46:25 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:25 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:25 user nova-compute[75206]:       <target dev="tap8666e24f-b9"/>
Nov 29 21:46:25 user nova-compute[75206]:     </interface>
Nov 29 21:46:25 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:25 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/console.log" append="off"/>
Nov 29 21:46:25 user nova-compute[75206]:     </serial>
Nov 29 21:46:25 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:25 user nova-compute[75206]:     <video>
Nov 29 21:46:25 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:25 user nova-compute[75206]:     </video>
Nov 29 21:46:25 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:25 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:25 user nova-compute[75206]:     </rng>
Nov 29 21:46:25 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:25 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:25 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:25 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:25 user nova-compute[75206]:   </devices>
Nov 29 21:46:25 user nova-compute[75206]: </domain>
Nov 29 21:46:25 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1274081142',display_name='tempest-VolumesActionsTest-instance-1274081142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1274081142',id=10,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e43f811cf51c4aecbbd7cf1ddcc86ae6',ramdisk_id='',reservation_id='r-dxexybqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1393828904',owner_user_name='tempest-VolumesActionsTest-1393828904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:23Z,user_data=None,user_id='cc10cde1c0834ba39ca989d7ebafae93',uuid=10941f43-65df-44a1-8c6d-22a8ef71bcff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converting VIF {"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG os_vif [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05075182-29f6-5274-9eeb-4999fd79863b', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8666e24f-b9, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8666e24f-b9, col_values=(('qos', UUID('f7d5d69c-5bd1-40c8-ad63-19b92ef0cebe')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8666e24f-b9, col_values=(('external_ids', {'iface-id': '8666e24f-b9da-4b2e-80e5-b5e58d7b6728', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:c5:1b', 'vm-uuid': '10941f43-65df-44a1-8c6d-22a8ef71bcff'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:25 user nova-compute[75206]: INFO os_vif [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9')
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] No VIF found with MAC fa:16:3e:7d:c5:1b, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Updated VIF entry in instance network info cache for port 8666e24f-b9da-4b2e-80e5-b5e58d7b6728. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Updating instance_info_cache with network_info: [{"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b59e33e6-e2cd-454f-87b5-05e2b9ed1926 req-25b15e75-6db0-43cb-8186-178b62dd40b3 service nova] Releasing lock "refresh_cache-10941f43-65df-44a1-8c6d-22a8ef71bcff" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Skipping network cache update for instance because it is Building. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Skipping network cache update for instance because it is Building. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:46:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating instance_info_cache with network_info: [{"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:46:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:28 user nova-compute[75206]: DEBUG nova.compute.manager [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:28 user nova-compute[75206]: DEBUG nova.compute.manager [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] No waiting events found dispatching network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:28 user nova-compute[75206]: WARNING nova.compute.manager [req-df994639-d321-474c-9492-46cf875b9db2 req-15362bd7-a073-4507-8dda-4bb2844747fe service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received unexpected event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 for instance with vm_state building and task_state spawning.
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:29 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Instance spawned successfully.
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:30 user nova-compute[75206]: INFO nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:30 user nova-compute[75206]: INFO nova.compute.manager [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Took 7.88 seconds to build instance.
Nov 29 21:46:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6f432eb9-2dee-41ef-b0ef-3fbf437efe68 tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.047s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] No waiting events found dispatching network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:30 user nova-compute[75206]: WARNING nova.compute.manager [req-80c21413-a60a-4b06-ba8c-bee6bb5b0b18 req-d32a3341-a261-4790-b0af-033761af2381 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received unexpected event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 for instance with vm_state active and task_state None.
Nov 29 21:46:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:46:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Creating image(s)
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Ensure instance console log exists: /opt/stack/data/nova/instances/d402a442-7a9d-4b60-9ce5-413fd24e23e8/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Start _get_guest_xml network_info=[{"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'c7b4f3b1-a18d-4174-934b-3099efe99a27', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd402a442-7a9d-4b60-9ce5-413fd24e23e8', 'attached_at': '', 'detached_at': '', 'volume_id': '28e66982-2444-45e3-bd55-0bd94990ca4a', 'serial': '28e66982-2444-45e3-bd55-0bd94990ca4a'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:46:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:46:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connector [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Factory for ISCSI on None {{(pid=75206) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:32 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:46:32 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:46:32 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a176f-5c5d-4df9-8728-2d3b2c505fec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:46:32 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b359907-116c-4c00-93ae-3e8a632c0089]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a] added
Nov 29 21:46:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec802700-130d-4bf3-9717-e580d8e01691]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b6be59-f511-49fc-afdf-a3eb94807bba]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjRlHIFG {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjRlHIFG" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa7d80-ce3c-474e-bcf3-4da1596a076c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PjRlHIFG'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6898f701-3068-4fc8-a14e-fdde132693e5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e1cea-510c-4259-b8ab-1fe185acadd1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:46:32 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:46:32 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:46:32 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 21:46:32 user nova-compute[75206]: 
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ceb5d-885f-41e5-bf14-bc086668802b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260]
Nov 29 21:46:32 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260] successful.
Nov 29 21:46:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44878f-fdaf-46ea-948c-e8cda31aff45]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a34362-de64-449a-af71-7686b6347d6a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:46:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:46:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cd982-d790-4b2c-ae8e-6d5ff23ebc1d]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:46:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23665353037396465', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665353037396465', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-897035615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-897035615',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WI3fjxWugO36zCSvx0fH2n1R2EF5FiZN3G8z52zchTJcg0FZr+UGAJWwpPUanLyG4gdQkSvk5dY3kjKQ1KUX1a7KkGFsUPHB1isvelw1uIK0h1IJnNo/oy/bf+5LRXw==',key_name='tempest-keypair-1248799511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca012700c6b4badb992b35e8a80ca0c',ramdisk_id='',reservation_id='r-1j46pyxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-323563625',owner_user_name='tempest-ServerActionsV293TestJSON-323563625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf037e0205444fdb984ea545d1e323ce',uuid=d402a442-7a9d-4b60-9ce5-413fd24e23e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converting VIF {"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lazy-loading 'pci_devices' on Instance uuid d402a442-7a9d-4b60-9ce5-413fd24e23e8 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:46:33 user nova-compute[75206]:   <uuid>d402a442-7a9d-4b60-9ce5-413fd24e23e8</uuid>
Nov 29 21:46:33 user nova-compute[75206]:   <name>instance-00000009</name>
Nov 29 21:46:33 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:46:33 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:46:33 user nova-compute[75206]:   <metadata>
Nov 29 21:46:33 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:46:33 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:46:33 user nova-compute[75206]:       <nova:name>tempest-ServerActionsV293TestJSON-server-897035615</nova:name>
Nov 29 21:46:33 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:46:31</nova:creationTime>
Nov 29 21:46:33 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:46:33 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:46:33 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:46:33 user nova-compute[75206]:       <nova:owner>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:user uuid="bf037e0205444fdb984ea545d1e323ce">tempest-ServerActionsV293TestJSON-323563625-project-member</nova:user>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:project uuid="7ca012700c6b4badb992b35e8a80ca0c">tempest-ServerActionsV293TestJSON-323563625</nova:project>
Nov 29 21:46:33 user nova-compute[75206]:       </nova:owner>
Nov 29 21:46:33 user nova-compute[75206]:       <nova:ports>
Nov 29 21:46:33 user nova-compute[75206]:         <nova:port uuid="e1a603d4-d84b-4f30-8419-1c72d68dc14c">
Nov 29 21:46:33 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 21:46:33 user nova-compute[75206]:         </nova:port>
Nov 29 21:46:33 user nova-compute[75206]:       </nova:ports>
Nov 29 21:46:33 user nova-compute[75206]:     </nova:instance>
Nov 29 21:46:33 user nova-compute[75206]:   </metadata>
Nov 29 21:46:33 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:46:33 user nova-compute[75206]:     <system>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="serial">d402a442-7a9d-4b60-9ce5-413fd24e23e8</entry>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="uuid">d402a442-7a9d-4b60-9ce5-413fd24e23e8</entry>
Nov 29 21:46:33 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:46:33 user nova-compute[75206]:     </system>
Nov 29 21:46:33 user nova-compute[75206]:   </sysinfo>
Nov 29 21:46:33 user nova-compute[75206]:   <os>
Nov 29 21:46:33 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:46:33 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:46:33 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:46:33 user nova-compute[75206]:   </os>
Nov 29 21:46:33 user nova-compute[75206]:   <features>
Nov 29 21:46:33 user nova-compute[75206]:     <acpi/>
Nov 29 21:46:33 user nova-compute[75206]:     <apic/>
Nov 29 21:46:33 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:46:33 user nova-compute[75206]:   </features>
Nov 29 21:46:33 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:46:33 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:46:33 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:46:33 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:46:33 user nova-compute[75206]:   </clock>
Nov 29 21:46:33 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:46:33 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:46:33 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:46:33 user nova-compute[75206]:   </cpu>
Nov 29 21:46:33 user nova-compute[75206]:   <devices>
Nov 29 21:46:33 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:46:33 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:46:33 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 21:46:33 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:46:33 user nova-compute[75206]:       <serial>28e66982-2444-45e3-bd55-0bd94990ca4a</serial>
Nov 29 21:46:33 user nova-compute[75206]:     </disk>
Nov 29 21:46:33 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:46:33 user nova-compute[75206]:       <mac address="fa:16:3e:44:6f:cf"/>
Nov 29 21:46:33 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:33 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:46:33 user nova-compute[75206]:       <target dev="tape1a603d4-d8"/>
Nov 29 21:46:33 user nova-compute[75206]:     </interface>
Nov 29 21:46:33 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:46:33 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/d402a442-7a9d-4b60-9ce5-413fd24e23e8/console.log" append="off"/>
Nov 29 21:46:33 user nova-compute[75206]:     </serial>
Nov 29 21:46:33 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:46:33 user nova-compute[75206]:     <video>
Nov 29 21:46:33 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:46:33 user nova-compute[75206]:     </video>
Nov 29 21:46:33 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:46:33 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:46:33 user nova-compute[75206]:     </rng>
Nov 29 21:46:33 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:46:33 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:46:33 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:46:33 user nova-compute[75206]:     </memballoon>
Nov 29 21:46:33 user nova-compute[75206]:   </devices>
Nov 29 21:46:33 user nova-compute[75206]: </domain>
Nov 29 21:46:33 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-897035615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-897035615',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WI3fjxWugO36zCSvx0fH2n1R2EF5FiZN3G8z52zchTJcg0FZr+UGAJWwpPUanLyG4gdQkSvk5dY3kjKQ1KUX1a7KkGFsUPHB1isvelw1uIK0h1IJnNo/oy/bf+5LRXw==',key_name='tempest-keypair-1248799511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca012700c6b4badb992b35e8a80ca0c',ramdisk_id='',reservation_id='r-1j46pyxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-323563625',owner_user_name='tempest-ServerActionsV293TestJSON-323563625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf037e0205444fdb984ea545d1e323ce',uuid=d402a442-7a9d-4b60-9ce5-413fd24e23e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converting VIF {"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG os_vif [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06f6810a-3bc2-507b-9c74-109293b35b3a', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a603d4-d8, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1a603d4-d8, col_values=(('qos', UUID('fb47f808-2f5a-44cb-a869-f2f2bbd0859f')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1a603d4-d8, col_values=(('external_ids', {'iface-id': 'e1a603d4-d84b-4f30-8419-1c72d68dc14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:6f:cf', 'vm-uuid': 'd402a442-7a9d-4b60-9ce5-413fd24e23e8'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:33 user nova-compute[75206]: INFO os_vif [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8')
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:46:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] No VIF found with MAC fa:16:3e:44:6f:cf, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:46:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] No waiting events found dispatching network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:35 user nova-compute[75206]: WARNING nova.compute.manager [req-98058f17-3758-4669-ba45-cdda80810aed req-7db77914-242e-4b7a-9c9b-23f29e44c02d service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received unexpected event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c for instance with vm_state building and task_state spawning.
Nov 29 21:46:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:36 user nova-compute[75206]: INFO nova.compute.claims [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Claim successful on node user
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:36 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] No waiting events found dispatching network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:46:37 user nova-compute[75206]: WARNING nova.compute.manager [req-06d2394b-1e81-487c-87c1-d002e1194b31 req-acff5f11-b664-469e-90a5-341c27e280de service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received unexpected event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c for instance with vm_state building and task_state spawning.
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.policy [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4102481099d84d949d494dd93cef2705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf157f7c013240258c902914acaabef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:37 user nova-compute[75206]: INFO nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Booting with volume 3d6bc040-742a-4d77-88c6-9085a3a1ad1f at /dev/vda
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa1706-8178-44de-b43b-6e23fe027341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance spawned successfully.
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27633c5-3e79-4812-ba2e-532d5064a756]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e47eb6-b5d2-4410-82b5-e4765589ebc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7452f1c-82d9-4f3b-b7a6-48d85a770d61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:37 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e68b7-7cc5-4272-872f-684db9ce466e]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating existing volume attachment record: 0ab8e335-6a4c-4ea3-8b73-2c7348d6f2d6 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:37 user nova-compute[75206]: INFO nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 21:46:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:46:37 user nova-compute[75206]: INFO nova.compute.manager [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Took 24.94 seconds to build instance.
Nov 29 21:46:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a4f1ae9-520d-4356-9cc1-a8290a415694 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.140s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:38 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully created port: e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully created port: 0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully created port: b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully created port: d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully created port: f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:46:43 user nova-compute[75206]: INFO nova.compute.claims [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Claim successful on node user
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1c471e94-0b8a-4457-8e36-2411df39daa4 req-ea6672ae-9154-499f-9840-bbae5d2d6897 service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:46:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:46:43 user nova-compute[75206]: INFO nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Booting with volume 1a03be09-3da5-4c04-89f9-7ce188ca9a09 at /dev/vda
Nov 29 21:46:43 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[972fe5ab-a8f0-41ff-bffe-36e1a785966e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: 084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b43945-9558-47c7-8f72-6c8a309b27de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c0238-15b3-4aa3-bc47-0156c3d841aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15952b-60e8-4d93-87d3-f5000cb7ff87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:44 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f5bbe-bfdb-48dd-b6b0-f0bedc93ced4]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating existing volume attachment record: 4a7f795a-5f28-4faf-8839-4b120f0f689c {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG nova.policy [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efb35e952c3f47e4bc10724200fa2200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de865030aefa4a62972e7c5f2f3c258d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-084a3081-bd6c-4235-a590-a87f95c6dab4. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:44 user nova-compute[75206]: DEBUG nova.network.neutron [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port 084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: 13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully created port: 2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aae7b0c8-5525-4087-b5f9-49f94d0053d9 req-801214ce-25d3-4f31-9c71-b48084d81713 service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully created port: ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:46 user nova-compute[75206]: INFO nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Booting with volume 1565c46b-1afc-48ab-bd14-cbf396703d39 at /dev/vdb
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d4b68-3f50-4cd7-995f-3ca73f3ec782]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfbbc92-0876-4445-9824-c1cf80edbaaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: 0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc267bd9-7925-4f7b-8b4a-99c73adea334]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9d13f7-9bb5-4943-a536-03e1fd281eb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:46 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1cb5c-fb21-4ca6-835e-1d427c70abc2]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating existing volume attachment record: 6b4af207-9179-4fcb-b19c-4e35a9848e59 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-13f0c831-f563-45ca-b5f7-2760710b571c. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port 13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully created port: cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-0a291081-f93a-4a78-856c-cc46905f299d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port 0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c73bf5b9-aaec-46b9-9b90-f0039780fd4c req-e8166622-29ce-4a67-93f2-26075316c4c4 service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully created port: eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-b471f367-23a6-44a7-ae2a-b65bd2cf100f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully created port: e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-d99b2e48-9ad7-4898-88a8-3a58267dfa7e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG nova.network.neutron [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-10f3a400-9169-4da2-ace6-2b60a6f31f54 req-c117e35a-8fb3-4fc6-b9e3-473a313c6a4f service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Successfully updated port: f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: 2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-f77f981c-9597-4938-98e3-3192df53316d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: 726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:53 user nova-compute[75206]: INFO nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Booting with volume 186effb7-edce-429e-8f1d-e15d76d589e4 at /dev/vdb
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-726c22fc-0bba-46ca-a41a-7f92ebd434d0. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port 726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c81e01-9a12-4f91-a05f-42629ab599af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dadafc-aa2e-4cd5-b025-d9bb11c13f8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cca50f-4102-4870-86f6-0d552b1f97e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a749dda-75b5-4edb-ac66-be8fb9e74c90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:53 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec2ba96-9ca3-4f18-b7f0-85277be40702]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating existing volume attachment record: a2e6aaeb-c961-40bf-acfb-5f091f0eeb98 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe29f3e4-3235-46dd-9de1-d9d58a9d507c req-884f42ca-b071-4f14-8a4f-2ffefb62a7a5 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance network_info: |[{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updated VIF entry in instance network info cache for port f77f981c-9597-4938-98e3-3192df53316d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-2ae72bdd-b11b-485f-9c2a-88a8be974699. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port 2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9e464d0c-142c-44ad-965f-748299fb4ef1 req-f75d1aeb-8b62-499e-959c-38c03e14cafe service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:55 user nova-compute[75206]: INFO nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Booting with volume 2ac10278-c91a-4136-9e2b-e07a516331ce at /dev/vdc
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-c08a3488-a024-4638-9e4a-cff2dc77a6f8. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e3980-2525-41c4-922d-3569e4d8f35f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81a91d2-81d5-49f0-92b1-2eef93de485a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2398c18-dfdf-419d-809a-a0f071fe8ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463e885-e78c-415e-a0f2-9693df44aa71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:46:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437011c-24bc-4d6a-8740-fcd108da57ea]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating existing volume attachment record: a55ee69d-2fbe-443a-8f36-37a05418a682 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-ff7c39d7-961d-4693-a004-2b36c4646f75. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-cdaa3e53-1ed8-4709-91ee-2bddd60e6381. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-257266c5-0d95-44f4-895c-aa2540cc0b5b req-c0233545-f71a-416d-85ef-7bf23ec12b18 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Successfully updated port: e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance network_info: |[{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updated VIF entry in instance network info cache for port eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-e9af5315-3950-43e0-9633-84ac4b24859f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updated VIF entry in instance network info cache for port e9af5315-3950-43e0-9633-84ac4b24859f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:46:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3887a0a-326a-4058-875b-4555ed43257a req-cc3cee89-62e2-49dc-a1cd-b61642f69e15 service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:01 user nova-compute[75206]: INFO nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Booting with volume 7f385abf-7b9e-4f5c-867e-c23c1d84209b at /dev/vdc
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df00d66-fb49-413a-bb5e-9d7dd42ddb05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db48353-71ca-4705-97c4-90bf6f5042ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e8d9b-4e94-4aa7-9b79-09196d78fd4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0adca1-35c1-4f6f-9627-8c3d264501cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:01 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd3118f-8519-4339-88c5-a969c319e133]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG os_brick.utils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:01 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating existing volume attachment record: 8f486543-b777-4926-8a0c-f70398bb770d {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:47:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Creating image(s)
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Ensure instance console log exists: /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Start _get_guest_xml network_info=[{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '0ab8e335-6a4c-4ea3-8b73-2c7348d6f2d6', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfuXIFkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74a96333-49ef-42c7-9acd-11870a310704', 'attached_at': '', 'detached_at': '', 'volume_id': '3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 'serial': '3d6bc040-742a-4d77-88c6-9085a3a1ad1f'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '6b4af207-9179-4fcb-b19c-4e35a9848e59', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfVrcYoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74a96333-49ef-42c7-9acd-11870a310704', 'attached_at': '', 'detached_at': '', 'volume_id': '1565c46b-1afc-48ab-bd14-cbf396703d39', 'serial': '1565c46b-1afc-48ab-bd14-cbf396703d39'}, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'a55ee69d-2fbe-443a-8f36-37a05418a682', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEmoJRgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74a96333-49ef-42c7-9acd-11870a310704', 'attached_at': '', 'detached_at': '', 'volume_id': '2ac10278-c91a-4136-9e2b-e07a516331ce', 'serial': '2ac10278-c91a-4136-9e2b-e07a516331ce'}, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:03 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:03 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfuXIFkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:03 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29d7652-c000-421d-a62b-0f72c59c36ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:03 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a63f42d-7597-4bed-9fa3-16210a5d46d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f] added
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79eda18-0451-4b0a-b68c-52eaf3303a0b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7b75a-77e2-4a14-bb4b-95d00bf451db]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfuXIFkv {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfuXIFkv" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9696e6-135b-482e-a324-ec63f5efaf97]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfuXIFkv'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43edbaf5-0c84-42c2-a871-7acf864f5968]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e3702d-7555-4d32-bd2b-8f1d8accfae1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b15a9-533b-44d2-b5bf-fc39e74617ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260]
Nov 29 21:47:03 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e108a5a-9d8b-4c50-82f9-d6315b27db4d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4db302-1a26-4127-9928-1ff8cd51f908]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:03 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:03 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c4bfc-5d45-49da-8c76-db01db35b222]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfuXIFkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23263626135353739', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263626135353739', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfVrcYoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:04 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:04 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:04 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4a98f-559e-409c-b3b2-be669ab9809a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:04 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc23914-071f-4d79-8d3e-5deb492d0359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39] added
Nov 29 21:47:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3fb670-9a9d-488b-847a-9e4bcfe8efc9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c233ff1-87d9-4f91-915a-7cfba7bddb9f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfVrcYoB {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfVrcYoB" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc05914c-9a32-433a-af74-f794e504e5f5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfVrcYoB'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db64d872-a54f-4b68-b991-694b575e69d3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[415692cf-7009-43c0-9b67-44352dedf40a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b869ce-b61f-43c8-bdcd-e62a4ecd1105]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260]
Nov 29 21:47:05 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f27f7b8-7dfd-4cbf-bcad-0f907d974e87]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ec4fa-81f2-4063-8713-0fe4a52bfaa0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:05 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c7e51-01d1-4da3-aa6a-637d34a0a606]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfVrcYoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23764353830353533', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764353830353533', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEmoJRgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:06 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a61b31-b19a-45be-9aaf-37298f5e00ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:06 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f19c69-82ce-4dc3-8b1e-003d6d94d42d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce] added
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[273baaa9-7b2c-4a4d-9978-04f6ca2bbe9a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce6564-f39b-4267-8fac-6c410f70a9bd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEmoJRgV {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEmoJRgV" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b73b01-b975-4289-9c79-4cdce524bcaa]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hEmoJRgV'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031d9ae-fdf1-4c54-b7af-3bf73a9f9d7a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725ba31-fc08-4b2e-bcbe-3ee1337c5e59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c82506-1516-42c3-b8a9-7b6cb7fa86dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260]
Nov 29 21:47:06 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f375b-9335-437b-8262-b83aece19d11]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b5ead-ba0f-4ee0-b8e1-7935e482b24a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:06 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ae03b-a4db-47de-8c3f-dcfb74c60c85]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEmoJRgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23433316438313762', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433316438313762', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lazy-loading 'pci_devices' on Instance uuid 74a96333-49ef-42c7-9acd-11870a310704 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:47:07 user nova-compute[75206]:   <uuid>74a96333-49ef-42c7-9acd-11870a310704</uuid>
Nov 29 21:47:07 user nova-compute[75206]:   <name>instance-0000000b</name>
Nov 29 21:47:07 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:47:07 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:47:07 user nova-compute[75206]:   <metadata>
Nov 29 21:47:07 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:47:07 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:name>tempest-device-tagging-server-1546071047</nova:name>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:47:03</nova:creationTime>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:47:07 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:47:07 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:owner>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:user uuid="4102481099d84d949d494dd93cef2705">tempest-TaggedBootDevicesTest-983513582-project-member</nova:user>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:project uuid="cf157f7c013240258c902914acaabef5">tempest-TaggedBootDevicesTest-983513582</nova:project>
Nov 29 21:47:07 user nova-compute[75206]:       </nova:owner>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:47:07 user nova-compute[75206]:       <nova:ports>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="e7d9b0d6-7f50-42c4-963e-a33d6118c9c5">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="084a3081-bd6c-4235-a590-a87f95c6dab4">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="13f0c831-f563-45ca-b5f7-2760710b571c">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="0a291081-f93a-4a78-856c-cc46905f299d">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="b471f367-23a6-44a7-ae2a-b65bd2cf100f">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="d99b2e48-9ad7-4898-88a8-3a58267dfa7e">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:         <nova:port uuid="f77f981c-9597-4938-98e3-3192df53316d">
Nov 29 21:47:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 21:47:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:07 user nova-compute[75206]:       </nova:ports>
Nov 29 21:47:07 user nova-compute[75206]:     </nova:instance>
Nov 29 21:47:07 user nova-compute[75206]:   </metadata>
Nov 29 21:47:07 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:47:07 user nova-compute[75206]:     <system>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="serial">74a96333-49ef-42c7-9acd-11870a310704</entry>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="uuid">74a96333-49ef-42c7-9acd-11870a310704</entry>
Nov 29 21:47:07 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:47:07 user nova-compute[75206]:     </system>
Nov 29 21:47:07 user nova-compute[75206]:   </sysinfo>
Nov 29 21:47:07 user nova-compute[75206]:   <os>
Nov 29 21:47:07 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:47:07 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:47:07 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:47:07 user nova-compute[75206]:   </os>
Nov 29 21:47:07 user nova-compute[75206]:   <features>
Nov 29 21:47:07 user nova-compute[75206]:     <acpi/>
Nov 29 21:47:07 user nova-compute[75206]:     <apic/>
Nov 29 21:47:07 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:47:07 user nova-compute[75206]:   </features>
Nov 29 21:47:07 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:47:07 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:47:07 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:47:07 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:47:07 user nova-compute[75206]:   </clock>
Nov 29 21:47:07 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:47:07 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:47:07 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:47:07 user nova-compute[75206]:   </cpu>
Nov 29 21:47:07 user nova-compute[75206]:   <devices>
Nov 29 21:47:07 user nova-compute[75206]:     <disk type="file" device="cdrom">
Nov 29 21:47:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 21:47:07 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/disk.config"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="hda" bus="ide"/>
Nov 29 21:47:07 user nova-compute[75206]:     </disk>
Nov 29 21:47:07 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:07 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <serial>3d6bc040-742a-4d77-88c6-9085a3a1ad1f</serial>
Nov 29 21:47:07 user nova-compute[75206]:     </disk>
Nov 29 21:47:07 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:07 user nova-compute[75206]:       <source dev="/dev/sdd"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <serial>1565c46b-1afc-48ab-bd14-cbf396703d39</serial>
Nov 29 21:47:07 user nova-compute[75206]:     </disk>
Nov 29 21:47:07 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:07 user nova-compute[75206]:       <source dev="/dev/sde"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="vdc" bus="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <serial>2ac10278-c91a-4136-9e2b-e07a516331ce</serial>
Nov 29 21:47:07 user nova-compute[75206]:     </disk>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:d2:f2:0f"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tape7d9b0d6-7f"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:88:7f:42"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tap084a3081-bd"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:78:e9:3a"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tap13f0c831-f5"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:ea:fc:bb"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tap0a291081-f9"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:45:17:52"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tapb471f367-23"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:be:ec:5c"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tapd99b2e48-9a"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:07 user nova-compute[75206]:       <mac address="fa:16:3e:93:12:a7"/>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:07 user nova-compute[75206]:       <target dev="tapf77f981c-95"/>
Nov 29 21:47:07 user nova-compute[75206]:     </interface>
Nov 29 21:47:07 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:47:07 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/console.log" append="off"/>
Nov 29 21:47:07 user nova-compute[75206]:     </serial>
Nov 29 21:47:07 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:47:07 user nova-compute[75206]:     <video>
Nov 29 21:47:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:07 user nova-compute[75206]:     </video>
Nov 29 21:47:07 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:47:07 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:47:07 user nova-compute[75206]:     </rng>
Nov 29 21:47:07 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:47:07 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:47:07 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:47:07 user nova-compute[75206]:     </memballoon>
Nov 29 21:47:07 user nova-compute[75206]:   </devices>
Nov 29 21:47:07 user nova-compute[75206]: </domain>
Nov 29 21:47:07 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '177f48f9-7ca5-5d35-8d9d-9499b106bec0', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7d9b0d6-7f, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7d9b0d6-7f, col_values=(('qos', UUID('57e6c3ef-f220-4124-a334-afc484ecd7b2')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7d9b0d6-7f, col_values=(('external_ids', {'iface-id': 'e7d9b0d6-7f50-42c4-963e-a33d6118c9c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:f2:0f', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f')
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa340a1c-5c17-5286-a94e-4f927f815fdd', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084a3081-bd, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084a3081-bd, col_values=(('qos', UUID('01b5e6a1-bdab-4d4f-ada6-fbafd08305ae')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084a3081-bd, col_values=(('external_ids', {'iface-id': '084a3081-bd6c-4235-a590-a87f95c6dab4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:7f:42', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd')
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50382e69-a767-58c4-a8c5-238d166bf336', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13f0c831-f5, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13f0c831-f5, col_values=(('qos', UUID('651afd85-dafa-4007-bd93-05f728f5baf3')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13f0c831-f5, col_values=(('external_ids', {'iface-id': '13f0c831-f563-45ca-b5f7-2760710b571c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:e9:3a', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5')
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83cd29c8-8972-5dc1-b450-da449061e8a8', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a291081-f9, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a291081-f9, col_values=(('qos', UUID('fbde8f06-5360-44ac-a80a-581f21b8a9cf')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a291081-f9, col_values=(('external_ids', {'iface-id': '0a291081-f93a-4a78-856c-cc46905f299d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:fc:bb', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9')
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0841757-0421-58c1-8a86-9d8f4bd41b05', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb471f367-23, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb471f367-23, col_values=(('qos', UUID('a75ba572-0926-4757-9795-942d832128d0')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb471f367-23, col_values=(('external_ids', {'iface-id': 'b471f367-23a6-44a7-ae2a-b65bd2cf100f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:17:52', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23')
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bed2b68-9fa7-599c-a0de-473f8d8f73df', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99b2e48-9a, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd99b2e48-9a, col_values=(('qos', UUID('a2fb44e5-9cc6-4c98-9f3e-7731967efc80')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd99b2e48-9a, col_values=(('external_ids', {'iface-id': 'd99b2e48-9ad7-4898-88a8-3a58267dfa7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ec:5c', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a')
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bc8edae-2f83-5cc6-9d0e-c4ef5ffcc4c1', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf77f981c-95, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf77f981c-95, col_values=(('qos', UUID('36b6a88e-f86a-429e-9b7c-46d57ab1377d')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf77f981c-95, col_values=(('external_ids', {'iface-id': 'f77f981c-9597-4938-98e3-3192df53316d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:12:a7', 'vm-uuid': '74a96333-49ef-42c7-9acd-11870a310704'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:08 user nova-compute[75206]: INFO os_vif [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95')
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] No BDM found with device name hda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] No VIF found with MAC fa:16:3e:d2:f2:0f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] No VIF found with MAC fa:16:3e:45:17:52, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Using config drive
Nov 29 21:47:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Creating config drive at /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/disk.config
Nov 29 21:47:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpde19ky8o {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpde19ky8o" returned: 0 in 0.066s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:10 user nova-compute[75206]: WARNING nova.compute.manager [req-4b334708-ed80-4244-8e32-36d088222622 req-a5693056-2970-49d3-a535-35c39557a9ee service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 for instance with vm_state building and task_state spawning.
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:47:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Creating image(s)
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Ensure instance console log exists: /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Start _get_guest_xml network_info=[{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '4a7f795a-5f28-4faf-8839-4b120f0f689c', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXkaPUOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857', 'attached_at': '', 'detached_at': '', 'volume_id': '1a03be09-3da5-4c04-89f9-7ce188ca9a09', 'serial': '1a03be09-3da5-4c04-89f9-7ce188ca9a09'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'a2e6aaeb-c961-40bf-acfb-5f091f0eeb98', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbJoVfED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857', 'attached_at': '', 'detached_at': '', 'volume_id': '186effb7-edce-429e-8f1d-e15d76d589e4', 'serial': '186effb7-edce-429e-8f1d-e15d76d589e4'}, 'disk_bus': 'virtio', 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'attachment_id': '8f486543-b777-4926-8a0c-f70398bb770d', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCKytVbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857', 'attached_at': '', 'detached_at': '', 'volume_id': '7f385abf-7b9e-4f5c-867e-c23c1d84209b', 'serial': '7f385abf-7b9e-4f5c-867e-c23c1d84209b'}, 'disk_bus': 'virtio', 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXkaPUOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:10 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:10 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:10 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a9fd0f-a9f6-4683-be9d-ddc6dd0a1c52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:10 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.134s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d364cd8-b323-43c3-a836-0f750e55ba59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09] added
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ecdc2-fd1e-4449-8c11-010f1b50735a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3135e53-d791-4e95-93fa-27e481a4b61b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXkaPUOe {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXkaPUOe" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c17c2-82dd-4417-b50b-0605292aa4bb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXkaPUOe'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a544938-4fc0-4716-af57-5a014f0c5d9e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5cde93-c333-486b-be2c-51a88edbfe65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:10 user nova-compute[75206]: WARNING nova.compute.manager [req-c834d2a6-86b3-462a-ac6d-96d4de091936 req-ea71d332-13f2-4290-b98b-843b0510c861 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c for instance with vm_state building and task_state spawning.
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a068b3-68ec-4c49-89ed-d98c8d16abd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260]
Nov 29 21:47:10 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aafc9b-7fd9-4e49-bc26-daeec86d1663]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fdf2ae-1dbb-4cf7-b0ac-bd212cb507a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:10 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:10 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4aaab9-d3f4-475d-b037-451cc903254a]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXkaPUOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26565663930646165', 'path': '/dev/sdf'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565663930646165', 'path': '/dev/sdf'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbJoVfED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:12 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aaffda-b630-4ed6-962c-b58a7b867808]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:12 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5680a-eafa-480a-bf29-2839c587c095]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4] added
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44baf926-bd1f-47db-889f-5eb18e6b9300]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7d632-51ef-418c-98d8-8c0a4f167f6e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbJoVfED {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbJoVfED" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbde2e6-cc97-476a-b15f-810c9f047ba0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zbJoVfED'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-2e41e0a8-529f-43e7-a946-204e32785f7a req-12e3f724-254f-4c36-b2dc-ba1d27065524 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a9278-55ef-4938-be86-dcaf3656e8da]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f804eccf-3e54-434e-a33e-4259867f4213]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b826389-68db-4f97-8cb1-fe8f6dc77379]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260]
Nov 29 21:47:12 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254a323-26ff-43a4-8841-3d6b829d92c8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbdf130-e785-4057-80d4-06bb45319c5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f6959-0708-4e7f-b655-fbab238dae8b]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbJoVfED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d for instance with vm_state building and task_state spawning.
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:12 user nova-compute[75206]: WARNING nova.compute.manager [req-d44cab32-1f4e-4b29-b0d4-78ce48376b29 req-5fad87bc-21f9-4ac7-ba41-172549941582 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d for instance with vm_state building and task_state spawning.
Nov 29 21:47:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26439323362356461', 'path': '/dev/sdg'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439323362356461', 'path': '/dev/sdg'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCKytVbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:13 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48771e7a-5b81-44db-8946-ae3f6d23af2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:13 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e36418-1243-4138-a6f3-5f5d72b22428]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b] added
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c68a01-a2df-4252-b404-d1b326e7c76d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[297d203c-e519-4c80-8b46-c2b87e700c93]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCKytVbv {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCKytVbv" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020e937-0e27-43ec-9d96-b8943fe7be3d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MCKytVbv'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43bab40-37c2-4e53-b72b-f9449c10bd12]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d1b824-3d40-4a89-81a8-62deb0be4322]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9efd19-72f9-4efa-988b-c27c348fb4a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260]
Nov 29 21:47:13 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33171c6-915d-4aa1-9448-1069f15a921a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[02239f6b-3652-468e-b34b-67f3012793dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:13 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[786dd4bf-fbe7-4c97-ab55-d4307a72fde7]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCKytVbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:47:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance spawned successfully.
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:14 user nova-compute[75206]: INFO nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Took 10.66 seconds to spawn the instance on the hypervisor.
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:47:14 user nova-compute[75206]: INFO nova.compute.manager [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Took 37.89 seconds to build instance.
Nov 29 21:47:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b6576b2-cd0a-4999-a493-8185f93c56f5 tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.028s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23661383939636639', 'path': '/dev/sdh'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661383939636639', 'path': '/dev/sdh'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lazy-loading 'pci_devices' on Instance uuid a18ab8e4-8948-4de3-bb06-d0b72cedc857 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:47:14 user nova-compute[75206]:   <uuid>a18ab8e4-8948-4de3-bb06-d0b72cedc857</uuid>
Nov 29 21:47:14 user nova-compute[75206]:   <name>instance-0000000c</name>
Nov 29 21:47:14 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:47:14 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:47:14 user nova-compute[75206]:   <metadata>
Nov 29 21:47:14 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:47:14 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:name>tempest-device-tagging-server-1697802926</nova:name>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:47:10</nova:creationTime>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:47:14 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:47:14 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:owner>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:user uuid="efb35e952c3f47e4bc10724200fa2200">tempest-TaggedBootDevicesTest_v242-1499903624-project-member</nova:user>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:project uuid="de865030aefa4a62972e7c5f2f3c258d">tempest-TaggedBootDevicesTest_v242-1499903624</nova:project>
Nov 29 21:47:14 user nova-compute[75206]:       </nova:owner>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:47:14 user nova-compute[75206]:       <nova:ports>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="2ae72bdd-b11b-485f-9c2a-88a8be974699">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="726c22fc-0bba-46ca-a41a-7f92ebd434d0">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="c08a3488-a024-4638-9e4a-cff2dc77a6f8">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="ff7c39d7-961d-4693-a004-2b36c4646f75">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="cdaa3e53-1ed8-4709-91ee-2bddd60e6381">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:         <nova:port uuid="e9af5315-3950-43e0-9633-84ac4b24859f">
Nov 29 21:47:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 21:47:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:47:14 user nova-compute[75206]:       </nova:ports>
Nov 29 21:47:14 user nova-compute[75206]:     </nova:instance>
Nov 29 21:47:14 user nova-compute[75206]:   </metadata>
Nov 29 21:47:14 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:47:14 user nova-compute[75206]:     <system>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="serial">a18ab8e4-8948-4de3-bb06-d0b72cedc857</entry>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="uuid">a18ab8e4-8948-4de3-bb06-d0b72cedc857</entry>
Nov 29 21:47:14 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:47:14 user nova-compute[75206]:     </system>
Nov 29 21:47:14 user nova-compute[75206]:   </sysinfo>
Nov 29 21:47:14 user nova-compute[75206]:   <os>
Nov 29 21:47:14 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:47:14 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:47:14 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:47:14 user nova-compute[75206]:   </os>
Nov 29 21:47:14 user nova-compute[75206]:   <features>
Nov 29 21:47:14 user nova-compute[75206]:     <acpi/>
Nov 29 21:47:14 user nova-compute[75206]:     <apic/>
Nov 29 21:47:14 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:47:14 user nova-compute[75206]:   </features>
Nov 29 21:47:14 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:47:14 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:47:14 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:47:14 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:47:14 user nova-compute[75206]:   </clock>
Nov 29 21:47:14 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:47:14 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:47:14 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:47:14 user nova-compute[75206]:   </cpu>
Nov 29 21:47:14 user nova-compute[75206]:   <devices>
Nov 29 21:47:14 user nova-compute[75206]:     <disk type="file" device="cdrom">
Nov 29 21:47:14 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 21:47:14 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/disk.config"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="hda" bus="ide"/>
Nov 29 21:47:14 user nova-compute[75206]:     </disk>
Nov 29 21:47:14 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:14 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:14 user nova-compute[75206]:       <source dev="/dev/sdf"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <serial>1a03be09-3da5-4c04-89f9-7ce188ca9a09</serial>
Nov 29 21:47:14 user nova-compute[75206]:     </disk>
Nov 29 21:47:14 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:14 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:14 user nova-compute[75206]:       <source dev="/dev/sdg"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <serial>186effb7-edce-429e-8f1d-e15d76d589e4</serial>
Nov 29 21:47:14 user nova-compute[75206]:     </disk>
Nov 29 21:47:14 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:47:14 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:14 user nova-compute[75206]:       <source dev="/dev/sdh"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="vdc" bus="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <serial>7f385abf-7b9e-4f5c-867e-c23c1d84209b</serial>
Nov 29 21:47:14 user nova-compute[75206]:     </disk>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:14:4d:cb"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tap2ae72bdd-b1"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:6b:a8:5c"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tap726c22fc-0b"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:fb:b5:1a"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tapc08a3488-a0"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:ad:da:e8"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tapff7c39d7-96"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:c3:b6:13"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tapcdaa3e53-1e"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:01:57:0a"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tapeb356aaa-5e"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:47:14 user nova-compute[75206]:       <mac address="fa:16:3e:a4:d4:04"/>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:47:14 user nova-compute[75206]:       <target dev="tape9af5315-39"/>
Nov 29 21:47:14 user nova-compute[75206]:     </interface>
Nov 29 21:47:14 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:47:14 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/console.log" append="off"/>
Nov 29 21:47:14 user nova-compute[75206]:     </serial>
Nov 29 21:47:14 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:47:14 user nova-compute[75206]:     <video>
Nov 29 21:47:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:47:14 user nova-compute[75206]:     </video>
Nov 29 21:47:14 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:47:14 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:47:14 user nova-compute[75206]:     </rng>
Nov 29 21:47:14 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:47:14 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:47:14 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:47:14 user nova-compute[75206]:     </memballoon>
Nov 29 21:47:14 user nova-compute[75206]:   </devices>
Nov 29 21:47:14 user nova-compute[75206]: </domain>
Nov 29 21:47:14 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6df2be85-00be-5128-be34-1b7dc2ba3e16', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ae72bdd-b1, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ae72bdd-b1, col_values=(('qos', UUID('2832cc96-4819-47f2-8dfa-5b0a9edc47f4')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ae72bdd-b1, col_values=(('external_ids', {'iface-id': '2ae72bdd-b11b-485f-9c2a-88a8be974699', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4d:cb', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1')
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18c986fc-8bc2-56d1-91c7-943199753e9f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap726c22fc-0b, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap726c22fc-0b, col_values=(('qos', UUID('1256253c-3d02-4d44-b63e-d0f6df061d97')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap726c22fc-0b, col_values=(('external_ids', {'iface-id': '726c22fc-0bba-46ca-a41a-7f92ebd434d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:a8:5c', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b')
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f316f45-fb21-51f8-8218-5bb937072c56', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc08a3488-a0, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc08a3488-a0, col_values=(('qos', UUID('2a6e6a67-eced-4393-9155-c63ac8dfb74f')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc08a3488-a0, col_values=(('external_ids', {'iface-id': 'c08a3488-a024-4638-9e4a-cff2dc77a6f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:b5:1a', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0')
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb82e7cb-87be-5482-bbbb-cf87e358ac8b', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff7c39d7-96, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff7c39d7-96, col_values=(('qos', UUID('708a27ab-1b71-4904-9412-065ed0099a29')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff7c39d7-96, col_values=(('external_ids', {'iface-id': 'ff7c39d7-961d-4693-a004-2b36c4646f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:da:e8', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96')
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fcbf06d-8c0d-5f1a-98ff-3cd133ded660', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdaa3e53-1e, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdaa3e53-1e, col_values=(('qos', UUID('55cb392b-8b88-414d-b152-354c891f1e77')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdaa3e53-1e, col_values=(('external_ids', {'iface-id': 'cdaa3e53-1ed8-4709-91ee-2bddd60e6381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:b6:13', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e')
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7ce7ded-f7bd-56cb-84d4-0988cafc3a35', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb356aaa-5e, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb356aaa-5e, col_values=(('qos', UUID('fb107f6e-b49c-4940-bb95-c3ebe8bc0218')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb356aaa-5e, col_values=(('external_ids', {'iface-id': 'eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:57:0a', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e')
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f585e57e-16e2-5345-937a-cc975b63e1aa', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9af5315-39, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9af5315-39, col_values=(('qos', UUID('116d2edc-2b30-4422-afb2-580a27509f29')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9af5315-39, col_values=(('external_ids', {'iface-id': 'e9af5315-3950-43e0-9633-84ac4b24859f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:d4:04', 'vm-uuid': 'a18ab8e4-8948-4de3-bb06-d0b72cedc857'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:15 user nova-compute[75206]: INFO os_vif [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39')
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] No BDM found with device name hda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] No VIF found with MAC fa:16:3e:14:4d:cb, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] No VIF found with MAC fa:16:3e:c3:b6:13, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Using config drive
Nov 29 21:47:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Creating config drive at /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/disk.config
Nov 29 21:47:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjshdvfyy {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjshdvfyy" returned: 0 in 0.052s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:18 user nova-compute[75206]: WARNING nova.compute.manager [req-9c0fa9f7-ae5a-4e30-8c15-9a71ed95ab0a req-bb2353e8-3265-4c8a-a9f9-00c43aeaf67c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 for instance with vm_state building and task_state spawning.
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:18 user nova-compute[75206]: WARNING nova.compute.manager [req-7d7d969d-e24c-4e08-817e-e69749eb9f7d req-d1629e51-bcc1-4cef-ade5-7be65418ff01 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 for instance with vm_state building and task_state spawning.
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:18 user nova-compute[75206]: WARNING nova.compute.manager [req-1ee04504-c100-4948-acd7-556c43dbf68a req-3bfbe4a4-e202-462b-ac8b-94faf6ee1157 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 for instance with vm_state building and task_state spawning.
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:19 user nova-compute[75206]: WARNING nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 for instance with vm_state building and task_state spawning.
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:19 user nova-compute[75206]: WARNING nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 for instance with vm_state building and task_state spawning.
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:19 user nova-compute[75206]: WARNING nova.compute.manager [req-15db36e6-8eaa-442d-aa59-d1d063771c9f req-cc61aeca-5b06-4254-a023-5ea0778591d3 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 for instance with vm_state building and task_state spawning.
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-f09bf387-b0cd-45be-a28e-4f99c5a82c41 req-96ce2dad-a6db-4cc9-9463-0243ade4e00b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:20 user nova-compute[75206]: WARNING nova.compute.manager [req-b176fbf9-cfdd-4152-a392-63cc644154ac req-91cbf2cb-942d-4187-a39d-ffab3938a333 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 for instance with vm_state building and task_state spawning.
Nov 29 21:47:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lazy-loading 'flavor' on Instance uuid 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:21 user nova-compute[75206]: INFO nova.compute.manager [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Attaching volume dc2fab49-ec7a-4cf1-bf47-ddd47b077795 to /dev/vdb
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.utils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da06f4b-6a32-40cd-9f51-7824f387f422]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8cc22-f39d-4a14-b2ee-0867ca305bff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac2fa76-83d9-4d12-aea0-365e0ea0e161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[089654a3-73db-413d-bde7-fc158015bcb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:22 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91cbf23-131b-481d-b1f6-ee8ee8428ea8]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG os_brick.utils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating existing volume attachment record: 9b2c0e20-f90e-481d-aabb-8b4c58768da5 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:22 user nova-compute[75206]: WARNING nova.compute.manager [req-1e71f9cd-7009-4169-97f9-a6d4d997e9da req-76c81167-3990-4727-bb59-d78c0abf893b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f for instance with vm_state building and task_state spawning.
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance spawned successfully.
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:47:22 user nova-compute[75206]: INFO nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Took 11.97 seconds to spawn the instance on the hypervisor.
Nov 29 21:47:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: INFO nova.compute.manager [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Took 39.51 seconds to build instance.
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3a342bde-df94-404c-9a8f-271a0320ac0d tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.609s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:47:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:47:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=6904MB free_disk=25.398967742919922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:47:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b591b5dc-f459-4071-bc2a-277610d97ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 83c0ed70-6d8b-4c56-a3b2-907681b11f8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 10941f43-65df-44a1-8c6d-22a8ef71bcff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 74a96333-49ef-42c7-9acd-11870a310704 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a18ab8e4-8948-4de3-bb06-d0b72cedc857 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-changed-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Refreshing instance network info cache due to event network-changed-c085e7e9-fc00-4ca3-ae80-78307b0175d5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] Acquiring lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] Acquired lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.network.neutron [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Refreshing network info cache for port c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:47:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.476s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG nova.network.neutron [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updated VIF entry in instance network info cache for port c085e7e9-fc00-4ca3-ae80-78307b0175d5. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG nova.network.neutron [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [{"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b085c49c-6311-44f3-b0cd-2e25a966e7e6 req-6683dd27-9cd4-4947-a38b-1057d2b2c9b7 service nova] Releasing lock "refresh_cache-f343e212-3a5d-43e2-8b8b-81135caffb2d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZkOCnoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:33 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7074b-36bc-4b2b-abf7-6bc2be255a62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:33 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ea762d-748e-4f41-ad5c-bbc19150ee18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795] added
Nov 29 21:47:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b63d93-873e-45ab-974c-e2a00c622a27]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad960e-7a20-42c3-8920-4d4c3bb15022]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZkOCnoj {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IZkOCnoj" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[007dc293-cc90-4506-8b09-604d1bc52bfc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IZkOCnoj'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99c0a8-935a-4008-a61d-5a88f576c26b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f901469-8052-46b1-9a96-c8f44164826d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c060c6d-e1de-4de8-94f5-5830d1a89926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260]
Nov 29 21:47:34 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[032ff349-8f68-42e9-be78-60841e1df6bb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:34 user nova-compute[75206]: INFO nova.compute.manager [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Attaching volume c1085ba0-3c79-472b-bca8-ca3bb94e2872 to /dev/vdb
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e070b925-8202-43da-bb62-119e26a1cb7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:34 user nova-compute[75206]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)
Nov 29 21:47:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[804eaa7f-6385-4388-91bf-6ea79821000e]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZkOCnoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.utils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c976c5-5253-4281-bdc0-61f42255d7a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc10b2-7e6b-4d23-aa8a-fa8c1fdd1463]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec5f38-d0df-4fea-98ce-000be473f2d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a823e194-12ce-4dbc-9926-87ead6909b43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:34 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1aa5f6-2d2a-40b7-9405-d77aa00424f0]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG os_brick.utils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:34 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating existing volume attachment record: aaae8710-24f7-4f24-beab-62d10a1331d1 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26665623838623562', 'path': '/dev/sdi'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665623838623562', 'path': '/dev/sdi'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lazy-loading 'flavor' on Instance uuid 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:47:35 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:35 user nova-compute[75206]:   <source dev="/dev/sdi"/>
Nov 29 21:47:35 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:47:35 user nova-compute[75206]:   <serial>dc2fab49-ec7a-4cf1-bf47-ddd47b077795</serial>
Nov 29 21:47:35 user nova-compute[75206]: </disk>
Nov 29 21:47:35 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:47:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] No VIF found with MAC fa:16:3e:19:08:ce, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9fb64b6-02c3-40c3-a670-715adc557c73 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.272s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:37 user nova-compute[75206]: INFO nova.compute.manager [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Terminating instance
Nov 29 21:47:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-unplugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] No waiting events found dispatching network-vif-unplugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6acead4-3cf7-42d0-801f-89741795cbb6 req-2819e5f6-e4d1-4d10-81ea-8977143af05d service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-unplugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Instance destroyed successfully.
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lazy-loading 'resources' on Instance uuid 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1821517086',display_name='tempest-DeleteServersTestJSON-server-1821517086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1821517086',id=1,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c9c55ac93d5431cb012db09148aebf2',ramdisk_id='',reservation_id='r-fblalfcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-335161360',owner_user_name='tempest-DeleteServersTestJSON-335161360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:45:41Z,user_data=None,user_id='4c4c7e36918141ada3ee2176e53a01ec',uuid=46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converting VIF {"id": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "address": "fa:16:3e:19:08:ce", "network": {"id": "73a3597e-5e32-41a7-b5e0-f2e87de2e3d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2114146434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9c55ac93d5431cb012db09148aebf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4143beb8-7f", "ovs_interfaceid": "4143beb8-7fba-48e2-b60d-58820b4d5d85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_vif [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4143beb8-7f, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99b822dd-89a7-4a35-8235-52e53114cf54) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:38 user nova-compute[75206]: INFO os_vif [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:08:ce,bridge_name='br-int',has_traffic_filtering=True,id=4143beb8-7fba-48e2-b60d-58820b4d5d85,network=Network(73a3597e-5e32-41a7-b5e0-f2e87de2e3d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4143beb8-7f')
Nov 29 21:47:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IZkOCnoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:38 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb7a446-7e80-4f2e-9647-5734a511438e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:47:38 user nova-compute[75206]: No targets found.
Nov 29 21:47:38 user nova-compute[75206]: iSNS:
Nov 29 21:47:38 user nova-compute[75206]: No targets found.
Nov 29 21:47:38 user nova-compute[75206]: STATIC:
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:47:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:47:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:47:38 user nova-compute[75206]: FIRMWARE:
Nov 29 21:47:38 user nova-compute[75206]: No targets found.
Nov 29 21:47:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:47:38 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:47:38 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:47:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463f66d-dd61-4311-bbbc-2605daa7abce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a2aa72-aecf-413b-81a4-c6b2987b128c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:39 user nova-compute[75206]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 (non-flash)
Nov 29 21:47:39 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8279900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795'): ({'sdi'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Removing single pathed devices sdi {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d27ae7-827e-46b4-922a-15855efdc750]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de33cbd8-a963-4071-9637-3a9b312da44b]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Flushing IO for device /dev/sdi {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb412d5-e2d7-496c-b73f-892f0a85c407]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92eed1-ef9b-4a31-965d-40e04b338941]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] SCSI volumes sdi have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284c893-01c4-4f6b-8edd-57bd590f265a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665124d-5211-4d68-8b1a-f05639a145a8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260]
Nov 29 21:47:39 user nova-compute[75206]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:39 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2fab49-ec7a-4cf1-bf47-ddd47b077795 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d81252-c47b-4b35-ace1-f08511635f09]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] <== disconnect_volume: return (350ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Deleting instance files /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d_del
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Deletion of /opt/stack/data/nova/instances/46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d_del complete
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75206) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.virt.libvirt.host [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] UEFI support detected
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.compute.manager [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Took 1.86 seconds to destroy the instance on the hypervisor.
Nov 29 21:47:39 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Took 0.56 seconds to deallocate network for instance.
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-b7364582-ccea-4450-91c3-b01ba6f3383b req-3221903e-6060-496f-8de6-4f2f4309e882 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-deleted-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:39 user nova-compute[75206]: INFO nova.compute.manager [req-b7364582-ccea-4450-91c3-b01ba6f3383b req-3221903e-6060-496f-8de6-4f2f4309e882 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Neutron deleted interface 4143beb8-7fba-48e2-b60d-58820b4d5d85; detaching it from the instance and deleting it from the info cache
Nov 29 21:47:39 user nova-compute[75206]: DEBUG nova.network.neutron [req-b7364582-ccea-4450-91c3-b01ba6f3383b req-3221903e-6060-496f-8de6-4f2f4309e882 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b7364582-ccea-4450-91c3-b01ba6f3383b req-3221903e-6060-496f-8de6-4f2f4309e882 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Detach interface failed, port_id=4143beb8-7fba-48e2-b60d-58820b4d5d85, reason: Instance 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] Acquiring lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] No waiting events found dispatching network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:40 user nova-compute[75206]: WARNING nova.compute.manager [req-4b422502-b60c-45c5-8497-bd14b0ded0c6 req-cd5bdc72-cbef-42ad-85cc-0f20c635cbb0 service nova] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Received unexpected event network-vif-plugged-4143beb8-7fba-48e2-b60d-58820b4d5d85 for instance with vm_state active and task_state deleting.
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG nova.objects.instance [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lazy-loading 'flavor' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:41 user nova-compute[75206]: INFO nova.compute.manager [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attaching volume 2811f030-59f9-4d41-9319-6990514fc417 to /dev/vdb
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.utils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a43a7-bf40-474f-ac6f-06322223a87e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae0687-e8dc-4c40-a188-9aeaefc832e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c652c9b-dcdb-4b28-9928-b7080a0da8b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2843e46-2365-4064-b6e9-942e6acc5503]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:41 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34493735-0b9a-4f22-bee3-bfe6a71fed72]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG os_brick.utils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:41 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating existing volume attachment record: 83a69d48-e6ef-4f14-a052-8a2c470162bc {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-changed-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Refreshing instance network info cache due to event network-changed-afd32a60-abd7-4862-9579-2ba297343b82. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] Acquiring lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] Acquired lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Refreshing network info cache for port afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updated VIF entry in instance network info cache for port afd32a60-abd7-4862-9579-2ba297343b82. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating instance_info_cache with network_info: [{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e2db7e4-1623-46c6-847c-db802127db9e req-25ff2ed2-3484-490e-8e2d-9b9fb1985377 service nova] Releasing lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:44 user nova-compute[75206]: INFO nova.compute.manager [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] [instance: 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d] Took 4.37 seconds to detach 1 volumes for instance.
Nov 29 21:47:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:47:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:47:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:44 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Deleted allocations for instance 46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d
Nov 29 21:47:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a9ca4821-65cf-47d6-8f63-d22443a3adf1 tempest-DeleteServersTestJSON-335161360 tempest-DeleteServersTestJSON-335161360-project-member] Lock "46c1c3c1-d8ce-45fd-92ac-fd359b0e7f7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.535s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-changed-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Refreshing instance network info cache due to event network-changed-33b2c974-f064-470a-b5b1-ea9a4de1fff1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] Acquiring lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] Acquired lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Refreshing network info cache for port 33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-changed-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing instance network info cache due to event network-changed-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing network info cache for port f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.objects.instance [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.objects.instance [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'pci_requests' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.objects.base [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Object Instance<852f5aba-96eb-44f4-869a-aa635b6ec7e2> lazy-loaded attributes: flavor,pci_requests {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updated VIF entry in instance network info cache for port 33b2c974-f064-470a-b5b1-ea9a4de1fff1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating instance_info_cache with network_info: [{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c458f8e-d450-4fe3-a5a8-8ab75bb76fae req-fd5fff20-0312-4690-8e56-97dfe9122c00 service nova] Releasing lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.policy [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35c9d4e110194df38abc8f14b889bfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a62bab4355a485ba3863a0ad0314f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updated VIF entry in instance network info cache for port f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45e7cfce-2e30-4fb8-8920-e0a81c0c45c4 req-0cc8f00d-3c34-4c04-ab05-f2e5d41e1871 service nova] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Successfully created port: 2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-changed-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Refreshing instance network info cache due to event network-changed-a3889f06-a7d3-4fb9-ac39-2338a5e175d4. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] Acquiring lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] Acquired lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Refreshing network info cache for port a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Successfully updated port: 2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updated VIF entry in instance network info cache for port a3889f06-a7d3-4fb9-ac39-2338a5e175d4. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating instance_info_cache with network_info: [{"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-45cc7db3-32fd-4ba3-a0ce-e9ccd9ac3c59 req-bd0122eb-7fc9-413c-adf0-0c1bc3f6bbbe service nova] Releasing lock "refresh_cache-b591b5dc-f459-4071-bc2a-277610d97ecc" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-changed-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing instance network info cache due to event network-changed-2e195153-6399-4456-a867-0b5b187456a2. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Refreshing network info cache for port 2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG os_vif [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5ace5a3-da5a-5af7-abea-32340acfd8a7', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e195153-63, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e195153-63, col_values=(('qos', UUID('07360836-bd03-4cd7-9640-4bb6d73ef2e9')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e195153-63, col_values=(('external_ids', {'iface-id': '2e195153-6399-4456-a867-0b5b187456a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:6b:88', 'vm-uuid': '852f5aba-96eb-44f4-869a-aa635b6ec7e2'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: INFO os_vif [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63')
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] attach device xml: <interface type="ethernet">
Nov 29 21:47:49 user nova-compute[75206]:   <mac address="fa:16:3e:71:6b:88"/>
Nov 29 21:47:49 user nova-compute[75206]:   <model type="virtio"/>
Nov 29 21:47:49 user nova-compute[75206]:   <mtu size="1442"/>
Nov 29 21:47:49 user nova-compute[75206]:   <target dev="tap2e195153-63"/>
Nov 29 21:47:49 user nova-compute[75206]: </interface>
Nov 29 21:47:49 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updated VIF entry in instance network info cache for port 2e195153-6399-4456-a867-0b5b187456a2. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-af2641af-a9e5-4f90-848a-8d1491c5196a req-c783ff45-6872-419a-86c8-09f3b265e8c0 service nova] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:49 user nova-compute[75206]: WARNING nova.compute.manager [req-d3d6c187-1125-45e4-b9c0-96b6403794b3 req-a5ef8cf7-f7ad-4bf9-85a0-b73a48c40e73 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 for instance with vm_state active and task_state None.
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No VIF found with MAC fa:16:3e:e5:8b:14, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:47:49 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:47:49</nova:creationTime>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:47:49 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:47:49 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:owner>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:47:49 user nova-compute[75206]:   </nova:owner>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:47:49 user nova-compute[75206]:   <nova:ports>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:47:49 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:47:49 user nova-compute[75206]:     </nova:port>
Nov 29 21:47:49 user nova-compute[75206]:     <nova:port uuid="2e195153-6399-4456-a867-0b5b187456a2">
Nov 29 21:47:49 user nova-compute[75206]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Nov 29 21:47:49 user nova-compute[75206]:     </nova:port>
Nov 29 21:47:49 user nova-compute[75206]:   </nova:ports>
Nov 29 21:47:49 user nova-compute[75206]: </nova:instance>
Nov 29 21:47:49 user nova-compute[75206]:  {{(pid=75206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ce3239fb-ad3d-4d7a-b1ab-13251fde6d8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.607s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: INFO nova.compute.manager [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Attaching volume 05c8d810-33cb-4a58-8627-ecfa961a1bfd to /dev/vdb
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'flavor' on Instance uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lazy-loading 'flavor' on Instance uuid b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1668ad67-8567-407c-9e8a-8c3ad7f2a32d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c250a3-86b6-4acb-9694-aa391b360b63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[847939cc-e4a2-4e11-b731-27bdef70d1e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea17197-0e5a-40ab-9252-a0c5deca04a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:50 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706b547-e921-4956-a1e3-a0564202e8c5]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating existing volume attachment record: 353a8a27-6678-42d8-b390-dea536689178 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: INFO nova.compute.manager [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Attaching volume ca47f351-bcf3-4806-991a-6d62f2062635 to /dev/vdb
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:50 user nova-compute[75206]: INFO nova.compute.manager [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Attaching volume f5becc4e-523d-4bbf-92c9-07b21d4788c7 to /dev/sdc
Nov 29 21:47:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:47:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:47:51 user nova-compute[75206]: WARNING nova.compute.manager [req-65b27266-bd28-4bae-aaa1-501677909405 req-1870723d-eb40-4f48-8392-f9e12e0a4aba service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 for instance with vm_state active and task_state None.
Nov 29 21:47:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhPlHfem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:54 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03fb510-3903-409a-a1d6-70126ff71ee5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:54 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c67903b-2cce-445a-abf4-95a51a7cdd0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872] added
Nov 29 21:47:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515f557-1a2e-4a7a-8848-2a1f3269a9d6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21756ca-a92c-4a99-abee-e070c495ed57]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhPlHfem {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhPlHfem" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e294a-1ea6-4ab8-a462-fe60b298468c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZhPlHfem'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed800443-7108-4bd4-bb5a-921e6bd7ace8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaea5a-1d1c-4d04-84b5-59465a95163f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:55 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:55 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:55 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff36cf-dd65-49e8-a206-5c48eeecdd44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260]
Nov 29 21:47:55 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:55 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba10d9-9b2c-4b5e-9319-142768ee5e58]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d8d0e-541d-468b-a0d0-9bd19ead46a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d223e1f-15d3-4ad1-90c8-9cd14203685e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6263beb5-ba7f-4b78-ae8a-6a00b9d5ed48]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:55 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:55 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:55 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d591ca4-1d80-414c-845c-fa61d8039ee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82439b8f-75d1-4bcf-bfb0-684854051cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59bd521-8f04-48de-ae39-938db435899c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ed9b9-bef6-49d8-983a-825a0f82e44b]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035a036-61a5-4beb-94f0-3f4755844349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhPlHfem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff41682-45cb-41cc-a2cc-154e9504f453]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating existing volume attachment record: dc818d0b-d06a-4c21-be6c-202a51a91fd1 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa7a59a-e7a6-45f3-ba22-aff4054600bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06baf71d-d867-40da-9a99-8f858681a57c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:47:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:47:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5a4633-5999-4878-97d5-36d1070621b8]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:55 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating existing volume attachment record: 199a494e-828a-413c-b310-028a0ed3fae5 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23964373766363730', 'path': '/dev/sdi'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964373766363730', 'path': '/dev/sdi'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.188s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:56 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:56 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921c645-3212-4ab6-b189-e1d13ce2663b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:56 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:47:56 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:56 user nova-compute[75206]:   <source dev="/dev/sdi"/>
Nov 29 21:47:56 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:47:56 user nova-compute[75206]:   <serial>c1085ba0-3c79-472b-bca8-ca3bb94e2872</serial>
Nov 29 21:47:56 user nova-compute[75206]: </disk>
Nov 29 21:47:56 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08576f-b503-415f-9fc6-9625db5b01ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417] added
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b81f8b-b9d5-4045-9854-4a49132a0d12]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e060d-5082-45ac-973c-645e785c33eb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JELjxyDX {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JELjxyDX" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b547b16-e4ac-4364-9091-20a3f93b8724]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JELjxyDX'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85d0d99-26f8-44d5-93e6-0fa030b946f2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce382f-c8b9-4d9f-a9d2-0b100ecdf1f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a6deb-2d5c-4746-82aa-72dfec41cdb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]
Nov 29 21:47:56 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1751ed0-c943-43d0-a651-4313af5179ab]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169c1c4-eceb-4a39-8481-98960cef94de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:56 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:56 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df45e9b7-2586-4686-b2c3-94429a4092b2]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:ba:5c:28, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:57 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:47:57 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] <== connect_volume: return (2575ms) {'type': 'block', 'scsi_wwn': '26436393335613937', 'path': '/dev/sdj'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:47:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436393335613937', 'path': '/dev/sdj'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:47:57 user nova-compute[75206]: DEBUG nova.objects.instance [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lazy-loading 'flavor' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:47:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:47:57 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:47:57 user nova-compute[75206]:   <source dev="/dev/sdj"/>
Nov 29 21:47:57 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:47:57 user nova-compute[75206]:   <serial>2811f030-59f9-4d41-9319-6990514fc417</serial>
Nov 29 21:47:57 user nova-compute[75206]: </disk>
Nov 29 21:47:57 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:47:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:47:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] No VIF found with MAC fa:16:3e:5c:99:67, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsWbzCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:47:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:47:59 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef39a41f-fef8-4a52-8363-11c1ec823573]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:47:59 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3163e1-fe7b-4fef-a89f-eeac36a846b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd] added
Nov 29 21:47:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c14281-a74f-4aae-9d7d-e9407051af50]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b386a9-a99e-4823-a764-88c5802e5ee8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsWbzCmc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsWbzCmc" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be050983-24a1-40c6-9ccd-d465befdc704]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tsWbzCmc'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f5bc4-7985-4634-aa2c-8037ee28e974]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a4ad25-1fc4-4cf6-abec-90a68bfbe31d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:47:59 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:47:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:59 user nova-compute[75206]: INFO nova.compute.manager [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Terminating instance
Nov 29 21:47:59 user nova-compute[75206]: DEBUG nova.compute.manager [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3e6252-e938-46c6-9a6f-60645f4cc80e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260]
Nov 29 21:47:59 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260] successful.
Nov 29 21:47:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5549edc1-f6bb-4dbf-b61f-a18cc1c45798]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8a04936-3d6e-4c79-bc5e-7ee991feb70f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.720s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:47:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6272711-c3c1-4060-95e1-b2f2cd87199d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:00 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:00 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:00 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6751c0-de2e-47b6-8df3-c2e7f1a085f7]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsWbzCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-unplugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] No waiting events found dispatching network-vif-unplugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a47d48f-3fd2-4a43-8a9b-6bb268b77131 req-fb8f965e-bd2f-4dcb-83cd-c32c385830a5 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-unplugged-a4337e1c-bf33-4222-8048-13eea520609b for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-77eaa676-cfd5-4182-8fb7-02d323a62f5c tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.459s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Instance destroyed successfully.
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.objects.instance [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lazy-loading 'resources' on Instance uuid 83c0ed70-6d8b-4c56-a3b2-907681b11f8b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1898519636',display_name='tempest-VolumesActionsTest-instance-1898519636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1898519636',id=7,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-r3wr2bni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:14Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=83c0ed70-6d8b-4c56-a3b2-907681b11f8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "a4337e1c-bf33-4222-8048-13eea520609b", "address": "fa:16:3e:0a:c9:34", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4337e1c-bf", "ovs_interfaceid": "a4337e1c-bf33-4222-8048-13eea520609b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG os_vif [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4337e1c-bf, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79c1dea0-b2a7-4234-919a-10b8d6fae669) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:00 user nova-compute[75206]: INFO os_vif [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:34,bridge_name='br-int',has_traffic_filtering=True,id=a4337e1c-bf33-4222-8048-13eea520609b,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4337e1c-bf')
Nov 29 21:48:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Deleting instance files /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b_del
Nov 29 21:48:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Deletion of /opt/stack/data/nova/instances/83c0ed70-6d8b-4c56-a3b2-907681b11f8b_del complete
Nov 29 21:48:00 user nova-compute[75206]: INFO nova.compute.manager [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 21:48:00 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:48:00 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '26435666136333539', 'path': '/dev/sdk'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435666136333539', 'path': '/dev/sdk'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:48:01 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:01 user nova-compute[75206]:   <source dev="/dev/sdk"/>
Nov 29 21:48:01 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:01 user nova-compute[75206]:   <serial>05c8d810-33cb-4a58-8627-ecfa961a1bfd</serial>
Nov 29 21:48:01 user nova-compute[75206]: </disk>
Nov 29 21:48:01 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:01 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Took 0.47 seconds to deallocate network for instance.
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-ca4b0be7-af9e-47e7-9a87-7da23b2f0775 req-fad9bb08-6a4a-4146-834a-529532d1fb80 service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-deleted-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.utils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405d266-193f-4585-bd49-cf9681a14d9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ababb6-dcf5-4879-8da2-c3c781f8a59a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] No VIF found with MAC fa:16:3e:e5:8b:14, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e22713-d79c-4185-9bec-290f5cd79686]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a48edb-8072-4dd0-849d-d9fa75ac0952]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:01 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f043e9-cf2e-46b3-9334-fc6aede1a8ff]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG os_brick.utils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d970dc53-4af7-469a-8dd2-3d190d69df8d tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.517s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:01 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Deleted allocations for instance 83c0ed70-6d8b-4c56-a3b2-907681b11f8b
Nov 29 21:48:01 user nova-compute[75206]: INFO nova.compute.manager [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Swapping volume 2811f030-59f9-4d41-9319-6990514fc417 for 72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-da66331d-9cc7-44f6-b70f-9d6d9af89f1d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] Acquiring lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] Lock "83c0ed70-6d8b-4c56-a3b2-907681b11f8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] No waiting events found dispatching network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:02 user nova-compute[75206]: WARNING nova.compute.manager [req-3c414d8a-f5ab-4ea9-9021-f462a0f6a9ad req-81b039de-99db-4d41-9e75-0ca0b8f3bd2d service nova] [instance: 83c0ed70-6d8b-4c56-a3b2-907681b11f8b] Received unexpected event network-vif-plugged-a4337e1c-bf33-4222-8048-13eea520609b for instance with vm_state deleted and task_state None.
Nov 29 21:48:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-changed-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Refreshing instance network info cache due to event network-changed-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] Acquiring lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] Acquired lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Refreshing network info cache for port 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updated VIF entry in instance network info cache for port 457b41c0-a6b8-4e4b-95b3-ce0ace84edc5. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updating instance_info_cache with network_info: [{"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a592ed3-d5a5-4ba7-b132-aff70afdbd2b req-d6037b3d-9bab-4916-980c-e933e4ff6d32 service nova] Releasing lock "refresh_cache-94d891d6-a9e7-464e-b2d3-d829ba5cff8e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:48:03 user nova-compute[75206]: INFO nova.compute.claims [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Claim successful on node user
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:48:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-changed-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Refreshing instance network info cache due to event network-changed-e1a603d4-d84b-4f30-8419-1c72d68dc14c. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] Acquiring lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] Acquired lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.network.neutron [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Refreshing network info cache for port e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.policy [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9befc13bc6ec4d6fb37d297c6927602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8009177c2d4cebaee3848aba1eeded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:48:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Creating image(s)
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "/opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk 1073741824" returned: 0 in 0.051s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.network.neutron [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updated VIF entry in instance network info cache for port e1a603d4-d84b-4f30-8419-1c72d68dc14c. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.network.neutron [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating instance_info_cache with network_info: [{"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc74c225-80e5-44e4-a21d-2fc4ce9d3def req-ccc06cb8-f56a-451b-8c2e-eb1a4b6a91b5 service nova] Releasing lock "refresh_cache-d402a442-7a9d-4b60-9ce5-413fd24e23e8" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Cannot resize image /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Ensure instance console log exists: /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Successfully created port: f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Successfully updated port: f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquired lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-changed-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Refreshing instance network info cache due to event network-changed-f1547931-f5e1-4810-b319-708fcea975b3. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] Acquiring lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updating instance_info_cache with network_info: [{"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Releasing lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Instance network_info: |[{"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] Acquired lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Refreshing network info cache for port f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Start _get_guest_xml network_info=[{"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:48:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1339869918',display_name='tempest-AttachVolumeNegativeTest-server-1339869918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1339869918',id=13,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmmeRf4rEh198GVptTKAAKfxllGGT8H+uT402adx7v+vCK4/D1jybZd+biEIT/mPBaCfJKGpRLvYnPA2FOHd7vB9ow2ulwctMDTnYwJQUO8/zs2irzN8umPwrpN2y4hMw==',key_name='tempest-keypair-1082337245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-ekk8ijxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=c09afa7c-2278-41c1-af97-6fbeb5609d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'pci_devices' on Instance uuid c09afa7c-2278-41c1-af97-6fbeb5609d8b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:48:06 user nova-compute[75206]:   <uuid>c09afa7c-2278-41c1-af97-6fbeb5609d8b</uuid>
Nov 29 21:48:06 user nova-compute[75206]:   <name>instance-0000000d</name>
Nov 29 21:48:06 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:48:06 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:48:06 user nova-compute[75206]:   <metadata>
Nov 29 21:48:06 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:06 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1339869918</nova:name>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:48:06</nova:creationTime>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:48:06 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:06 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:owner>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:user uuid="9befc13bc6ec4d6fb37d297c6927602f">tempest-AttachVolumeNegativeTest-330553211-project-member</nova:user>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:project uuid="9e8009177c2d4cebaee3848aba1eeded">tempest-AttachVolumeNegativeTest-330553211</nova:project>
Nov 29 21:48:06 user nova-compute[75206]:       </nova:owner>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:06 user nova-compute[75206]:       <nova:ports>
Nov 29 21:48:06 user nova-compute[75206]:         <nova:port uuid="f1547931-f5e1-4810-b319-708fcea975b3">
Nov 29 21:48:06 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 21:48:06 user nova-compute[75206]:         </nova:port>
Nov 29 21:48:06 user nova-compute[75206]:       </nova:ports>
Nov 29 21:48:06 user nova-compute[75206]:     </nova:instance>
Nov 29 21:48:06 user nova-compute[75206]:   </metadata>
Nov 29 21:48:06 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:48:06 user nova-compute[75206]:     <system>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="serial">c09afa7c-2278-41c1-af97-6fbeb5609d8b</entry>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="uuid">c09afa7c-2278-41c1-af97-6fbeb5609d8b</entry>
Nov 29 21:48:06 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:48:06 user nova-compute[75206]:     </system>
Nov 29 21:48:06 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:06 user nova-compute[75206]:   <os>
Nov 29 21:48:06 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:48:06 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:48:06 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:48:06 user nova-compute[75206]:   </os>
Nov 29 21:48:06 user nova-compute[75206]:   <features>
Nov 29 21:48:06 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:06 user nova-compute[75206]:     <apic/>
Nov 29 21:48:06 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:48:06 user nova-compute[75206]:   </features>
Nov 29 21:48:06 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:48:06 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:48:06 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:48:06 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:48:06 user nova-compute[75206]:   </clock>
Nov 29 21:48:06 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:48:06 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:48:06 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:48:06 user nova-compute[75206]:   </cpu>
Nov 29 21:48:06 user nova-compute[75206]:   <devices>
Nov 29 21:48:06 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:48:06 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:48:06 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk"/>
Nov 29 21:48:06 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:48:06 user nova-compute[75206]:     </disk>
Nov 29 21:48:06 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:48:06 user nova-compute[75206]:       <mac address="fa:16:3e:94:8f:d5"/>
Nov 29 21:48:06 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:06 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:48:06 user nova-compute[75206]:       <target dev="tapf1547931-f5"/>
Nov 29 21:48:06 user nova-compute[75206]:     </interface>
Nov 29 21:48:06 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:48:06 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/console.log" append="off"/>
Nov 29 21:48:06 user nova-compute[75206]:     </serial>
Nov 29 21:48:06 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:48:06 user nova-compute[75206]:     <video>
Nov 29 21:48:06 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:06 user nova-compute[75206]:     </video>
Nov 29 21:48:06 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:48:06 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:48:06 user nova-compute[75206]:     </rng>
Nov 29 21:48:06 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:48:06 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:48:06 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:48:06 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:06 user nova-compute[75206]:   </devices>
Nov 29 21:48:06 user nova-compute[75206]: </domain>
Nov 29 21:48:06 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1339869918',display_name='tempest-AttachVolumeNegativeTest-server-1339869918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1339869918',id=13,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmmeRf4rEh198GVptTKAAKfxllGGT8H+uT402adx7v+vCK4/D1jybZd+biEIT/mPBaCfJKGpRLvYnPA2FOHd7vB9ow2ulwctMDTnYwJQUO8/zs2irzN8umPwrpN2y4hMw==',key_name='tempest-keypair-1082337245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-ekk8ijxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=c09afa7c-2278-41c1-af97-6fbeb5609d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG os_vif [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ef713fb-f7d1-558c-840d-a4068d237915', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1547931-f5, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1547931-f5, col_values=(('qos', UUID('add32fb8-0f10-4f72-8b1b-91bc0ac5e591')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1547931-f5, col_values=(('external_ids', {'iface-id': 'f1547931-f5e1-4810-b319-708fcea975b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:8f:d5', 'vm-uuid': 'c09afa7c-2278-41c1-af97-6fbeb5609d8b'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:06 user nova-compute[75206]: INFO os_vif [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5')
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:94:8f:d5, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:07 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updated VIF entry in instance network info cache for port f1547931-f5e1-4810-b319-708fcea975b3. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:07 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updating instance_info_cache with network_info: [{"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3c0d01b-66fe-4392-ae84-dd8067f78d01 req-6f761104-1092-4686-87b1-f4b54922e815 service nova] Releasing lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] No waiting events found dispatching network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:08 user nova-compute[75206]: WARNING nova.compute.manager [req-481180b7-e194-4505-aa3f-9e2feb65b75d req-51f04e02-76d9-4768-b447-413d5489cf8a service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received unexpected event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 for instance with vm_state building and task_state spawning.
Nov 29 21:48:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:48:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Instance spawned successfully.
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:48:10 user nova-compute[75206]: INFO nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] No waiting events found dispatching network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:10 user nova-compute[75206]: WARNING nova.compute.manager [req-a49f15de-7d82-41ee-ae55-985a152ce734 req-759605ca-826c-4132-a3c3-25b40bcdfc4d service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received unexpected event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 for instance with vm_state building and task_state spawning.
Nov 29 21:48:10 user nova-compute[75206]: INFO nova.compute.manager [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Took 6.70 seconds to build instance.
Nov 29 21:48:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-dbdaff9a-4b45-4db2-8076-6be8bbac836f tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74', 'serial': '72603443-3115-438a-b1ee-7547e2a1cf74'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '2811f030-59f9-4d41-9319-6990514fc417', 'serial'} {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:11 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:11 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:11 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc452b1f-02b3-41d8-9b03-1eb3169665d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:48:11 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1732dae7-5187-47fc-a21e-051aa9146f5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74] added
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8a8a29-c489-42f2-9aff-f398c2853e9d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef1df7d-0afb-4974-b1da-49611d86b68e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAFkWQZL {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAFkWQZL" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3427198-0324-475b-9c1a-6cadc9bbce86]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAFkWQZL'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lazy-loading 'flavor' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b373f-0af3-4faf-8185-940f52343aea]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd701a-6621-4810-af4a-faf141bda559]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7237679-31a3-42f1-a3dd-9f59a5c0a56d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260]
Nov 29 21:48:11 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69604fdc-3f09-4e7b-82b7-5022eb5eea6b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b34de-d572-4d74-96bf-1ea06ea02771]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:11 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0743aeb-6a02-4021-abf7-23cd8c6ba84a]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:12 user nova-compute[75206]: INFO nova.compute.manager [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Attaching volume dd7b1469-387a-4394-a0e2-6583b6347c68 to /dev/vdb
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7dd42-364e-449d-8a8d-41f7dca7fc7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31a2c7-56f4-4874-a8c3-4d2d5636f41b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db439fe-e852-43b6-b930-208f7d6e7271]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc174cf3-9792-470f-afd0-e6eea9c3112b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:12 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:48:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[793cfd43-7db3-49f5-aa58-15e7875cd649]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updating existing volume attachment record: fc539dd1-635b-40a4-957a-65971d3f0eb9 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:48:12 user nova-compute[75206]: INFO nova.compute.manager [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Rebuilding instance
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23339623935353566', 'path': '/dev/sdl'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339623935353566', 'path': '/dev/sdl'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:12 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lazy-loading 'flavor' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOikZjfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:13 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-vif-unplugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] No waiting events found dispatching network-vif-unplugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:13 user nova-compute[75206]: WARNING nova.compute.manager [req-9232378a-1cb7-44fe-bd32-791ce3b91538 req-f1a57f4f-fce7-4d61-997b-2095d3f377bc service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received unexpected event network-vif-unplugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c for instance with vm_state active and task_state rebuilding.
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f571e0a-de79-4dbe-8fb1-4b7956175c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:48:13 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUtbAuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a1521-04b8-4617-8835-b8e9441f22bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635] added
Nov 29 21:48:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0fc765-07f2-487f-9613-fb3e2021e636]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: INFO nova.compute.manager [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Detaching volume 05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5ddac-1f98-462c-a8f6-b34123a50bfb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOikZjfH {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rOikZjfH" returned: 0 in 0.039s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbb6a6-29e8-4d56-ae02-d78a45186db1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rOikZjfH'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c685c85-c9d5-46ba-bbe0-b42c46e3c739]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.069s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b221c68-86d9-4b87-87a0-b7e9d31633e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:13 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance destroyed successfully.
Nov 29 21:48:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance destroyed successfully.
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857059322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-897035615',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WI3fjxWugO36zCSvx0fH2n1R2EF5FiZN3G8z52zchTJcg0FZr+UGAJWwpPUanLyG4gdQkSvk5dY3kjKQ1KUX1a7KkGFsUPHB1isvelw1uIK0h1IJnNo/oy/bf+5LRXw==',key_name='tempest-keypair-1248799511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ca012700c6b4badb992b35e8a80ca0c',ramdisk_id='',reservation_id='r-1j46pyxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323563625',owner_user_name='tempest-ServerActionsV293TestJSON-323563625-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf037e0205444fdb984ea545d1e323ce',uuid=d402a442-7a9d-4b60-9ce5-413fd24e23e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converting VIF {"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG os_vif [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a603d4-d8, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb47f808-2f5a-44cb-a869-f2f2bbd0859f) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:13 user nova-compute[75206]: INFO nova.virt.block_device [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Attempting to driver detach volume 05c8d810-33cb-4a58-8627-ecfa961a1bfd from mountpoint /dev/vdb
Nov 29 21:48:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:13 user nova-compute[75206]: INFO os_vif [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8')
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:14 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Attempting to detach device vdb from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:14 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:14 user nova-compute[75206]:   <source dev="/dev/sdk"/>
Nov 29 21:48:14 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:14 user nova-compute[75206]:   <serial>05c8d810-33cb-4a58-8627-ecfa961a1bfd</serial>
Nov 29 21:48:14 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 21:48:14 user nova-compute[75206]: </disk>
Nov 29 21:48:14 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 152043520 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully detached device vdb from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the persistent domain config.
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:14 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:14 user nova-compute[75206]:   <source dev="/dev/sdk"/>
Nov 29 21:48:14 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:14 user nova-compute[75206]:   <serial>05c8d810-33cb-4a58-8627-ecfa961a1bfd</serial>
Nov 29 21:48:14 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 21:48:14 user nova-compute[75206]: </disk>
Nov 29 21:48:14 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --login" returned: 0 in 0.177s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ad17e4-b168-4e68-a13f-632391ac8f17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260]
Nov 29 21:48:14 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.074s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61276ed-ae81-445b-8643-db6698da0c7e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7019b-e9af-4742-898e-4ee7c77a7c05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:14 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.717s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c6206-b646-4c30-8a07-722ede551be3]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOikZjfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 238026752 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 402653184 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.779s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] <== connect_volume: return (1782ms) {'type': 'block', 'scsi_wwn': '26662626437623361', 'path': '/dev/sdm'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662626437623361', 'path': '/dev/sdm'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.724s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:15 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:15 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.objects.instance [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'flavor' on Instance uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[057700af-95e5-48ec-8d37-28606d332864]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:48:15 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:48:15 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:15 user nova-compute[75206]:   <source dev="/dev/sdm"/>
Nov 29 21:48:15 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:15 user nova-compute[75206]:   <serial>ca47f351-bcf3-4806-991a-6d62f2062635</serial>
Nov 29 21:48:15 user nova-compute[75206]: </disk>
Nov 29 21:48:15 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[410018bf-b1c7-4e6d-8094-25e24552babf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7] added
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e7212-c7ae-4700-8888-899fbe442e09]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6fbe67-3344-4f69-8445-db35eb5a154b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUtbAuOF {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUtbAuOF" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d09a17-b1e0-4909-a00c-d4afd350ba54]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUtbAuOF'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32335eb-3998-4c99-9242-6d79ebf37e55]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e42b433-19a4-45dd-a413-e328ad32dff5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] No waiting events found dispatching network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:15 user nova-compute[75206]: WARNING nova.compute.manager [req-492b7a44-8083-4e33-a468-08998bed2ea0 req-c9e7a3bf-7da1-4487-8ebf-88c75400879c service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received unexpected event network-vif-plugged-e1a603d4-d84b-4f30-8419-1c72d68dc14c for instance with vm_state active and task_state rebuilding.
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 530579456 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d240064-5c8e-4903-bf9c-4e000b79e38b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260]
Nov 29 21:48:15 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f0730-cb08-41fc-8002-81f4398e8145]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d729e005-33e0-4c47-b024-da517a2d9efa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:15 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] HCTL ('45', '-', '-', 0) found on session 15 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Scanning host 45 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host45/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host45/scan" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d475f-9886-4cce-8a27-e3ce80f90a3c]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Searching for a device in session 15 and hctl ['45', '*', '*', 0] yield: sdn {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Connected to sdn using {'target_iqn': 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUtbAuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No VIF found with MAC fa:16:3e:4d:22:7f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92c0eda8-1afe-4f6c-ade0-5ee002a5aee0 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.434s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 779091968 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.559s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] <== connect_volume: return (3283ms) {'type': 'block', 'scsi_wwn': '23165366339633834', 'path': '/dev/sdn'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165366339633834', 'path': '/dev/sdn'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.802s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.050s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8dbc9-d884-414d-a0cf-fe20f0f0d858]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:16 user nova-compute[75206]: No targets found.
Nov 29 21:48:16 user nova-compute[75206]: iSNS:
Nov 29 21:48:16 user nova-compute[75206]: No targets found.
Nov 29 21:48:16 user nova-compute[75206]: STATIC:
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:16 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:16 user nova-compute[75206]: No targets found.
Nov 29 21:48:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:16 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:16 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG nova.objects.instance [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lazy-loading 'flavor' on Instance uuid b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a218846-048a-4cb5-ae92-56f79977649e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4567b8c-6538-4aa1-961f-433a16e8ab8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:16 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8279360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:48:16 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:16 user nova-compute[75206]:   <source dev="/dev/sdn"/>
Nov 29 21:48:16 user nova-compute[75206]:   <target dev="sdc" bus="scsi"/>
Nov 29 21:48:16 user nova-compute[75206]:   <serial>f5becc4e-523d-4bbf-92c9-07b21d4788c7</serial>
Nov 29 21:48:16 user nova-compute[75206]:   <address type="drive" controller="0" unit="2"/>
Nov 29 21:48:16 user nova-compute[75206]: </disk>
Nov 29 21:48:16 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:48:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0008c0-1228-4515-a0f4-f7718ae63916]: (4, ('path checker states:\nup                  12\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f51e4b-b534-4dce-b2a9-508f997cebfe]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.094s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c38574-96b5-46a0-9f94-c0092dd41adc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.227s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3624aa78-1a2f-4dd8-8365-3318daa50cf8]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.162s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9461e-f7aa-4f3f-856b-d46a95286ab8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 883949568 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No BDM found with device name sda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] No VIF found with MAC fa:16:3e:09:ee:f5, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[879df1f8-4afe-4865-8b6c-56dfe72791b5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260]
Nov 29 21:48:17 user nova-compute[75206]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:17 user nova-compute[75206]: INFO nova.compute.manager [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Detaching volume ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a2513-b3d2-4594-95b2-a48f889574ee]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.067s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] <== disconnect_volume: return (3870ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Deleting instance files /opt/stack/data/nova/instances/d402a442-7a9d-4b60-9ce5-413fd24e23e8_del
Nov 29 21:48:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Deletion of /opt/stack/data/nova/instances/d402a442-7a9d-4b60-9ce5-413fd24e23e8_del complete
Nov 29 21:48:17 user nova-compute[75206]: INFO nova.virt.block_device [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Attempting to driver detach volume ca47f351-bcf3-4806-991a-6d62f2062635 from mountpoint /dev/vdb
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Attempting to detach device vdb from instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:17 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:17 user nova-compute[75206]:   <source dev="/dev/sdm"/>
Nov 29 21:48:17 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:17 user nova-compute[75206]:   <serial>ca47f351-bcf3-4806-991a-6d62f2062635</serial>
Nov 29 21:48:17 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:17 user nova-compute[75206]: </disk>
Nov 29 21:48:17 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully detached device vdb from instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd from the persistent domain config.
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:17 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:17 user nova-compute[75206]:   <source dev="/dev/sdm"/>
Nov 29 21:48:17 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:17 user nova-compute[75206]:   <serial>ca47f351-bcf3-4806-991a-6d62f2062635</serial>
Nov 29 21:48:17 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:17 user nova-compute[75206]: </disk>
Nov 29 21:48:17 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-16e8bc2f-fffb-4e50-9716-5d1a54c72296 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.332s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:18 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 could not be found.
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:18 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcf3ef0-b042-42e1-90b5-a2b4456cfc8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]: iSNS:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]: STATIC:
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:18 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:18 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 1026555904 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21011144-30b5-4280-a6f6-88182210b2ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[084659eb-02ed-442e-8251-30ba8c339f5e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:18 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c81e25f0>, {}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Disconnecting from: [] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.115s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] <== disconnect_volume: return (120ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:18 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6660ab7-b0fa-4e84-ad9d-b591dc5b3fb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]: iSNS:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]: STATIC:
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:18 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:18 user nova-compute[75206]: No targets found.
Nov 29 21:48:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:18 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:18 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d053b1-e1b2-416c-82cb-e926affc97ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27591a27-f06e-4e23-ae95-323834a4d759]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:19 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:19 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:19 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8108dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417'): ({'sdj'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Removing single pathed devices sdj {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f168700-736d-49f4-b1d3-58be7809747e]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e4720-73cb-42b1-86b7-ec5451948961]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Flushing IO for device /dev/sdj {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1d9876-4b9a-41d4-ba14-0792e8dba6a9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72acadae-f0ca-44a2-8f69-39241f43ba67]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] SCSI volumes sdj have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbfc2e2-6ed3-4d5d-b4b7-f45d64e87886]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa49ea-c765-4e70-a4fa-1d57aed81bde]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]
Nov 29 21:48:19 user nova-compute[75206]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:19 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c3aa12-0fac-4bf3-86e2-9b7c0b46e03c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== disconnect_volume: return (420ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74', 'serial'} {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: removing Cinder connection for volume 2811f030-59f9-4d41-9319-6990514fc417 {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Preparing to wait for external event volume-reimaged-28e66982-2444-45e3-bd55-0bd94990ca4a {{(pid=75206) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:19 user nova-compute[75206]: INFO nova.compute.manager [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Detaching volume f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:19 user nova-compute[75206]: INFO nova.virt.block_device [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Attempting to driver detach volume f5becc4e-523d-4bbf-92c9-07b21d4788c7 from mountpoint /dev/sdc
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Attempting to detach device sdc from instance b591b5dc-f459-4071-bc2a-277610d97ecc from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:19 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:19 user nova-compute[75206]:   <source dev="/dev/sdn"/>
Nov 29 21:48:19 user nova-compute[75206]:   <target dev="sdc" bus="scsi"/>
Nov 29 21:48:19 user nova-compute[75206]:   <serial>f5becc4e-523d-4bbf-92c9-07b21d4788c7</serial>
Nov 29 21:48:19 user nova-compute[75206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 21:48:19 user nova-compute[75206]: </disk>
Nov 29 21:48:19 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:19 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Successfully detached device sdc from instance b591b5dc-f459-4071-bc2a-277610d97ecc from the persistent domain config.
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b591b5dc-f459-4071-bc2a-277610d97ecc from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:19 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:19 user nova-compute[75206]:   <source dev="/dev/sdn"/>
Nov 29 21:48:19 user nova-compute[75206]:   <target dev="sdc" bus="scsi"/>
Nov 29 21:48:19 user nova-compute[75206]:   <serial>f5becc4e-523d-4bbf-92c9-07b21d4788c7</serial>
Nov 29 21:48:19 user nova-compute[75206]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 21:48:19 user nova-compute[75206]: </disk>
Nov 29 21:48:19 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: Updating volume 2811f030-59f9-4d41-9319-6990514fc417 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xAFkWQZL", "auth_password": "Ezqu8V10aAen9X", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "72603443-3115-438a-b1ee-7547e2a1cf74"}, "status": "reserved", "instance": "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0", "attached_at": "", "detached_at": "", "volume_id": "72603443-3115-438a-b1ee-7547e2a1cf74", "serial": "72603443-3115-438a-b1ee-7547e2a1cf74"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74', 'no_device': None, 'attachment_id': '75c92198-f493-466e-b5b6-d466445317b2'} {{(pid=75206) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b9686c98-1b84-4a61-84a3-e6da1df095cf tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.911s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating instance_info_cache with network_info: [{"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:48:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:21 user nova-compute[75206]: INFO nova.compute.manager [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Terminating instance
Nov 29 21:48:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-unplugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] No waiting events found dispatching network-vif-unplugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-04ab6f11-197c-4136-bad2-35f565d618cb req-cf218311-e68b-4ef0-9924-ce3be6263194 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-unplugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.utils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb3606-f9a1-43ca-a828-55d4e0d77a32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a82614-18c1-430e-8f30-c55343c6836a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e9b5d-0a82-477b-8cfe-66aa4b9f14ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c8822e-1e53-40b4-b1f6-8b9ec8d53224]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:48:21 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3db45-a500-4eae-8527-2f141312ac13]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG os_brick.utils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Instance destroyed successfully.
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lazy-loading 'resources' on Instance uuid 10941f43-65df-44a1-8c6d-22a8ef71bcff {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1274081142',display_name='tempest-VolumesActionsTest-instance-1274081142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1274081142',id=10,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e43f811cf51c4aecbbd7cf1ddcc86ae6',ramdisk_id='',reservation_id='r-dxexybqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1393828904',owner_user_name='tempest-VolumesActionsTest-1393828904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:30Z,user_data=None,user_id='cc10cde1c0834ba39ca989d7ebafae93',uuid=10941f43-65df-44a1-8c6d-22a8ef71bcff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converting VIF {"id": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "address": "fa:16:3e:7d:c5:1b", "network": {"id": "face1c80-217f-4a77-bd3d-2154c602fbc9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1039405649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e43f811cf51c4aecbbd7cf1ddcc86ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8666e24f-b9", "ovs_interfaceid": "8666e24f-b9da-4b2e-80e5-b5e58d7b6728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG os_vif [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8666e24f-b9, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7d5d69c-5bd1-40c8-ad63-19b92ef0cebe) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:22 user nova-compute[75206]: INFO os_vif [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:1b,bridge_name='br-int',has_traffic_filtering=True,id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728,network=Network(face1c80-217f-4a77-bd3d-2154c602fbc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8666e24f-b9')
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Deleting instance files /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff_del
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Deletion of /opt/stack/data/nova/instances/10941f43-65df-44a1-8c6d-22a8ef71bcff_del complete
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.compute.manager [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Swapping volume 72603443-3115-438a-b1ee-7547e2a1cf74 for 2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.compute.manager [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Took 0.44 seconds to deallocate network for instance.
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-0e93eb3b-adc8-4130-a4eb-534f0d9e3730 req-7345ba77-3859-49fa-9716-0137996e9991 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-deleted-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:22 user nova-compute[75206]: INFO nova.compute.manager [req-0e93eb3b-adc8-4130-a4eb-534f0d9e3730 req-7345ba77-3859-49fa-9716-0137996e9991 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Neutron deleted interface 8666e24f-b9da-4b2e-80e5-b5e58d7b6728; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.network.neutron [req-0e93eb3b-adc8-4130-a4eb-534f0d9e3730 req-7345ba77-3859-49fa-9716-0137996e9991 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-0e93eb3b-adc8-4130-a4eb-534f0d9e3730 req-7345ba77-3859-49fa-9716-0137996e9991 service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Detach interface failed, port_id=8666e24f-b9da-4b2e-80e5-b5e58d7b6728, reason: Instance 10941f43-65df-44a1-8c6d-22a8ef71bcff could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.917s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:23 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Deleted allocations for instance 10941f43-65df-44a1-8c6d-22a8ef71bcff
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] Acquiring lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] No waiting events found dispatching network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:23 user nova-compute[75206]: WARNING nova.compute.manager [req-ac9939bd-89de-4781-8e66-67bc6d044c15 req-3501e3f5-9311-492c-9346-898e108a44cb service nova] [instance: 10941f43-65df-44a1-8c6d-22a8ef71bcff] Received unexpected event network-vif-plugged-8666e24f-b9da-4b2e-80e5-b5e58d7b6728 for instance with vm_state deleted and task_state None.
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c7c31f0-3189-44c8-a58d-7714b89eea1f tempest-VolumesActionsTest-1393828904 tempest-VolumesActionsTest-1393828904-project-member] Lock "10941f43-65df-44a1-8c6d-22a8ef71bcff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '10941f43-65df-44a1-8c6d-22a8ef71bcff' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '10941f43-65df-44a1-8c6d-22a8ef71bcff' (instance-0000000a)
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IikXwQYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:24 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:24 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:24 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7216MB free_disk=25.432662963867188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f485d0-668f-42c2-b9b0-961c12950a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:48:24 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d7a395-939b-4b59-aa5f-eca8768e3f21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68] added
Nov 29 21:48:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08515171-f425-4da7-bb03-c6d833743a30]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e8370-97fd-45fc-9a43-e24584fd6a69]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IikXwQYr {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IikXwQYr" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c57a8-8f64-484f-a10d-6dcd4258a8e7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IikXwQYr'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b591b5dc-f459-4071-bc2a-277610d97ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 74a96333-49ef-42c7-9acd-11870a310704 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a18ab8e4-8948-4de3-bb06-d0b72cedc857 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c09afa7c-2278-41c1-af97-6fbeb5609d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72d6143-68f8-4bd4-a2bf-db772eff97eb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8f24e-660b-4d9b-a0ff-7d7115cc6bd8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:24 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d084f1-405e-40be-b0e1-bc1d1643379b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260]
Nov 29 21:48:24 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487d8e2-c996-4ff1-9c78-b8eadb37b63e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[840fb1a5-a012-44d4-a26e-cd8d710bd8b7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:25 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79244710-8538-470a-babe-5320c8655b54]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IikXwQYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:48:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23363623531333538', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363623531333538', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lazy-loading 'flavor' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 21:48:26 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:26 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:48:26 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:26 user nova-compute[75206]:   <serial>dd7b1469-387a-4394-a0e2-6583b6347c68</serial>
Nov 29 21:48:26 user nova-compute[75206]: </disk>
Nov 29 21:48:26 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] No VIF found with MAC fa:16:3e:11:8d:bd, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8ff7ab51-3101-4e42-b49d-e5574ba03785 tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.339s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] volume_snapshot_create: create_info: {'snapshot_id': '80ea036e-c318-4863-86cc-8fd21f264840', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75206) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] snap xml: <domainsnapshot>
Nov 29 21:48:27 user nova-compute[75206]:   <disks>
Nov 29 21:48:27 user nova-compute[75206]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 29 21:48:27 user nova-compute[75206]:       <source file="/dev/new_file"/>
Nov 29 21:48:27 user nova-compute[75206]:     </disk>
Nov 29 21:48:27 user nova-compute[75206]:     <disk name="vda" snapshot="no"/>
Nov 29 21:48:27 user nova-compute[75206]:   </disks>
Nov 29 21:48:27 user nova-compute[75206]: </domainsnapshot>
Nov 29 21:48:27 user nova-compute[75206]:  {{(pid=75206) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] Lazy-loading 'system_metadata' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     rv = execute(f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     six.reraise(c, e, tb)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     raise value
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     rv = meth(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     self._volume_snapshot_create(context, instance, guest,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     rv = execute(f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     six.reraise(c, e, tb)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     raise value
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     rv = meth(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] 
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-030b4673-5581-4298-91a3-bfa3a362d0fc tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] volume_snapshot_delete: delete_info: {'volume_id': 'dd7b1469-387a-4394-a0e2-6583b6347c68'} {{(pid=75206) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [None req-030b4673-5581-4298-91a3-bfa3a362d0fc tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e]     if delete_info['type'] != 'qcow2':
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] KeyError: 'type'
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 80ea036e-c318-4863-86cc-8fd21f264840 could not be found.
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 80ea036e-c318-4863-86cc-8fd21f264840 could not be found. (HTTP 404) (Request-ID: req-e91d8409-7920-4bde-aee3-d92987c106b4)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 80ea036e-c318-4863-86cc-8fd21f264840 could not be found.
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server [None req-d89001c3-f588-4939-88e1-7430cf54481d tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver [None req-030b4673-5581-4298-91a3-bfa3a362d0fc tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-396b8329-eeb1-4180-b70d-ea09ec2cf55d)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 21:48:27 user nova-compute[75206]: ERROR nova.virt.libvirt.driver 
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server [None req-030b4673-5581-4298-91a3-bfa3a362d0fc tempest-VolumesAssistedSnapshotsTest-126768910 tempest-VolumesAssistedSnapshotsTest-126768910-project] Exception during message handling: KeyError: 'type'
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 21:48:27 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 21:48:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:27 user nova-compute[75206]: INFO nova.compute.manager [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Detaching volume dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:27 user nova-compute[75206]: INFO nova.virt.block_device [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Attempting to driver detach volume dd7b1469-387a-4394-a0e2-6583b6347c68 from mountpoint /dev/vdb
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Attempting to detach device vdb from instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:27 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:27 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:48:27 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:27 user nova-compute[75206]:   <serial>dd7b1469-387a-4394-a0e2-6583b6347c68</serial>
Nov 29 21:48:27 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:27 user nova-compute[75206]: </disk>
Nov 29 21:48:27 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Successfully detached device vdb from instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e from the persistent domain config.
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:27 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:27 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:48:27 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:27 user nova-compute[75206]:   <serial>dd7b1469-387a-4394-a0e2-6583b6347c68</serial>
Nov 29 21:48:27 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:27 user nova-compute[75206]: </disk>
Nov 29 21:48:27 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-changed-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing instance network info cache due to event network-changed-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] Acquiring lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] Acquired lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:27 user nova-compute[75206]: DEBUG nova.network.neutron [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Refreshing network info cache for port e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:28 user nova-compute[75206]: DEBUG nova.network.neutron [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updated VIF entry in instance network info cache for port e7d9b0d6-7f50-42c4-963e-a33d6118c9c5. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:28 user nova-compute[75206]: DEBUG nova.network.neutron [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-efedba9e-cb7d-45b5-a898-fb607880ec54 req-681f4b82-fac2-4c2f-b2c8-00ac38fe9848 service nova] Releasing lock "refresh_cache-74a96333-49ef-42c7-9acd-11870a310704" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:30 user nova-compute[75206]: INFO nova.compute.manager [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Terminating instance
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-98292bd3-0aed-4023-a51e-7cdf05a4a961 req-a444ce6d-a091-4394-889d-d0aa9313a84e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-bab0daa7-b29e-4497-b804-9759636b0ae9 req-de706f15-4305-4fd2-8acd-1d491ead8156 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-13f0c831-f563-45ca-b5f7-2760710b571c for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Instance destroyed successfully.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.objects.instance [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lazy-loading 'resources' on Instance uuid 74a96333-49ef-42c7-9acd-11870a310704 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7d9b0d6-7f, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57e6c3ef-f220-4124-a334-afc484ecd7b2) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:f2:0f,bridge_name='br-int',has_traffic_filtering=True,id=e7d9b0d6-7f50-42c4-963e-a33d6118c9c5,network=Network(cc6492bb-95f2-4b27-b465-10e01cd7a5a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9b0d6-7f')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084a3081-bd, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01b5e6a1-bdab-4d4f-ada6-fbafd08305ae) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7f:42,bridge_name='br-int',has_traffic_filtering=True,id=084a3081-bd6c-4235-a590-a87f95c6dab4,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap084a3081-bd')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13f0c831-f5, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=651afd85-dafa-4007-bd93-05f728f5baf3) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=13f0c831-f563-45ca-b5f7-2760710b571c,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13f0c831-f5')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a291081-f9, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbde8f06-5360-44ac-a80a-581f21b8a9cf) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fc:bb,bridge_name='br-int',has_traffic_filtering=True,id=0a291081-f93a-4a78-856c-cc46905f299d,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a291081-f9')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "address": "fa:16:3e:45:17:52", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb471f367-23", "ovs_interfaceid": "b471f367-23a6-44a7-ae2a-b65bd2cf100f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb471f367-23, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a75ba572-0926-4757-9795-942d832128d0) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:17:52,bridge_name='br-int',has_traffic_filtering=True,id=b471f367-23a6-44a7-ae2a-b65bd2cf100f,network=Network(ea5a7499-a464-42a6-b1dc-1b0942056028),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb471f367-23')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99b2e48-9a, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2fb44e5-9cc6-4c98-9f3e-7731967efc80) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:5c,bridge_name='br-int',has_traffic_filtering=True,id=d99b2e48-9ad7-4898-88a8-3a58267dfa7e,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99b2e48-9a')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1546071047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1546071047',id=11,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAtkG/pfNdR7vNpvjnmUNwU3kh7lDdMG2Cbo7+kStLdogYC0FRTQgE3k0INjGO/4L4yKR0rZW3PTTxMZQ0fy7zNc1H6YEcli6AE4JKUqrTbzrlWMfrOPX5gVTfQZM7MNw==',key_name='tempest-keypair-1698672087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf157f7c013240258c902914acaabef5',ramdisk_id='',reservation_id='r-qq6kv0dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-983513582',owner_user_name='tempest-TaggedBootDevicesTest-983513582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4102481099d84d949d494dd93cef2705',uuid=74a96333-49ef-42c7-9acd-11870a310704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converting VIF {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf77f981c-95, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36b6a88e-f86a-429e-9b7c-46d57ab1377d) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:32 user nova-compute[75206]: INFO os_vif [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:12:a7,bridge_name='br-int',has_traffic_filtering=True,id=f77f981c-9597-4938-98e3-3192df53316d,network=Network(afc618f5-40e3-4f87-b3d1-0a129f3ef7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf77f981c-95')
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfuXIFkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad87796-cbde-4996-932f-390479496a38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:32 user nova-compute[75206]: No targets found.
Nov 29 21:48:32 user nova-compute[75206]: iSNS:
Nov 29 21:48:32 user nova-compute[75206]: No targets found.
Nov 29 21:48:32 user nova-compute[75206]: STATIC:
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:32 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:32 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:32 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:32 user nova-compute[75206]: No targets found.
Nov 29 21:48:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:32 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:32 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-084a3081-bd6c-4235-a590-a87f95c6dab4 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-084a3081-bd6c-4235-a590-a87f95c6dab4 for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-0a291081-f93a-4a78-856c-cc46905f299d for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-0a291081-f93a-4a78-856c-cc46905f299d for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-2c80da95-f017-4f00-87bf-bff00cefd4a2 req-d11de281-c0ee-4f97-9f0e-8b2eaa10d1d1 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-d99b2e48-9ad7-4898-88a8-3a58267dfa7e for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d93517-05c1-4ce6-8ea5-3cd9feee7655]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792dbd0-a7fd-4ad8-b925-9ef953a5b58e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:32 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b83ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d4cc7b-ca36-41d1-9939-698bee4c40db]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee2c408-e6ce-40b8-8924-72d3758a4865]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2cbc0-4b8e-4503-9e0d-2abc84b068cf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-13f0c831-f563-45ca-b5f7-2760710b571c for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-b471f367-23a6-44a7-ae2a-b65bd2cf100f for instance with vm_state active and task_state deleting.
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-unplugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-unplugged-f77f981c-9597-4938-98e3-3192df53316d for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Acquiring lock "74a96333-49ef-42c7-9acd-11870a310704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] Lock "74a96333-49ef-42c7-9acd-11870a310704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] No waiting events found dispatching network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:32 user nova-compute[75206]: WARNING nova.compute.manager [req-04c38b35-3467-4370-9cd5-d6905b9fa20c req-5110f0dc-1047-40c0-920a-be33240a49a4 service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received unexpected event network-vif-plugged-f77f981c-9597-4938-98e3-3192df53316d for instance with vm_state active and task_state deleting.
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[883fc107-3097-45b3-a870-c8463c63b55b]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1637e4-3236-4d28-a0f2-74f44567112c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7c168-f924-4404-ab2b-438a8401f360]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260]
Nov 29 21:48:33 user nova-compute[75206]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6bc040-742a-4d77-88c6-9085a3a1ad1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53789afa-d552-410f-9992-aeaa953dc36b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== disconnect_volume: return (468ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfVrcYoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc91f31-6b27-4c67-a0db-da288c36d227]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]: iSNS:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]: STATIC:
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:33 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:33 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878ff50-645e-4813-bfa4-500bd5c1b2d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a4138-c05d-4a63-96c8-82452d0d66de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b83ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26e456-fd51-4731-95e9-91e770b950fd]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6806e-4e9d-411c-a966-6adb03c7df4d]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b8a93e-0586-477c-a841-8db91b62c47e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa4f7a-71ae-400d-8a3d-a207913e1c53]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[573f5b7a-9668-4af0-a19e-57ebba6ee947]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfde63-e633-427f-baf7-dd4c56696a05]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260]
Nov 29 21:48:33 user nova-compute[75206]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1565c46b-1afc-48ab-bd14-cbf396703d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48672aaf-62f5-43c8-a048-459df230c937]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== disconnect_volume: return (429ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEmoJRgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18815998-3102-48ba-8ef1-3906d9455ce4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]: iSNS:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]: STATIC:
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:33 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:33 user nova-compute[75206]: No targets found.
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:33 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:33 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee86e10-140b-4fc3-927d-d6d98fb6f93a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03761c-abc6-4bc8-83dc-85c2bd42808a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:33 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c81e0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5319e57c-f0d5-4e93-b9cd-2c5db5a33935]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0633d5-cf8b-4a49-9061-8cd9265dd3b9]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf31ee7-0c91-4275-8e03-eadbd1fbac3b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ff781-e490-4c52-8afc-8dff9286f2f4]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2cafb-a5ef-4c3a-8f2d-02d466030b8b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4745a-5979-4a5d-8d50-0b112b7a6441]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260]
Nov 29 21:48:34 user nova-compute[75206]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac10278-c91a-4136-9e2b-e07a516331ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885816b-5592-43d5-9db4-178ac9c1095f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] <== disconnect_volume: return (429ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Deleting instance files /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704_del
Nov 29 21:48:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Deletion of /opt/stack/data/nova/instances/74a96333-49ef-42c7-9acd-11870a310704_del complete
Nov 29 21:48:34 user nova-compute[75206]: INFO nova.compute.manager [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Took 3.87 seconds to destroy the instance on the hypervisor.
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:48:34 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 is timed out.
Nov 29 21:48:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully detached device vdb from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the live domain config.
Nov 29 21:48:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsWbzCmc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:34 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73002b05-8582-418f-b3f4-d9e3d70f6db5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:34 user nova-compute[75206]: No targets found.
Nov 29 21:48:34 user nova-compute[75206]: iSNS:
Nov 29 21:48:34 user nova-compute[75206]: No targets found.
Nov 29 21:48:34 user nova-compute[75206]: STATIC:
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:34 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:34 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:34 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:34 user nova-compute[75206]: No targets found.
Nov 29 21:48:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:34 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:34 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4115f6-6031-4d19-9986-b94c5d7c2de7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922b2c2-e174-4f83-afce-9bcc0dedbc68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:34 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:34 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b83ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd'): ({'sdk'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Removing single pathed devices sdk {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fc348-39be-46b7-a631-749baf4a1d0a]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31378f6b-19f8-44cb-8c03-18b1f953616c]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Flushing IO for device /dev/sdk {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac592f01-8c1e-415b-903e-84ec76e050c8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d50010-f80b-4420-abd8-dc34ec3d3cd4]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] SCSI volumes sdk have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d5fef3-7684-4bea-899e-eb2bf31afbe8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ee33a-1d9d-4a15-a1f8-e7c797f1eb61]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260]
Nov 29 21:48:35 user nova-compute[75206]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:35 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-changed-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing instance network info cache due to event network-changed-2ae72bdd-b11b-485f-9c2a-88a8be974699. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] Acquiring lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] Acquired lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Refreshing network info cache for port 2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05c8d810-33cb-4a58-8627-ecfa961a1bfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84c22f-2943-42e0-bcf6-668220e27471]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] <== disconnect_volume: return (410ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updated VIF entry in instance network info cache for port 2ae72bdd-b11b-485f-9c2a-88a8be974699. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97321789-5f9c-4bf6-934b-0df25be70ce0 req-8c79137f-f1e7-49d6-a0cc-0795eec83ccb service nova] Releasing lock "refresh_cache-a18ab8e4-8948-4de3-bb06-d0b72cedc857" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a3004382-0dd5-462d-a7b8-9005c0a4b202 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.548s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-1bdbec72-d249-4119-917f-30f1aad71ffa req-b4f60b59-bf1c-4fa6-80cf-a9828bb91a9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-deleted-b471f367-23a6-44a7-ae2a-b65bd2cf100f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:36 user nova-compute[75206]: INFO nova.compute.manager [req-1bdbec72-d249-4119-917f-30f1aad71ffa req-b4f60b59-bf1c-4fa6-80cf-a9828bb91a9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Neutron deleted interface b471f367-23a6-44a7-ae2a-b65bd2cf100f; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-1bdbec72-d249-4119-917f-30f1aad71ffa req-b4f60b59-bf1c-4fa6-80cf-a9828bb91a9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f77f981c-9597-4938-98e3-3192df53316d", "address": "fa:16:3e:93:12:a7", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf77f981c-95", "ovs_interfaceid": "f77f981c-9597-4938-98e3-3192df53316d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-1bdbec72-d249-4119-917f-30f1aad71ffa req-b4f60b59-bf1c-4fa6-80cf-a9828bb91a9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Detach interface failed, port_id=b471f367-23a6-44a7-ae2a-b65bd2cf100f, reason: Instance 74a96333-49ef-42c7-9acd-11870a310704 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:36 user nova-compute[75206]: INFO nova.compute.manager [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Terminating instance
Nov 29 21:48:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:48:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-2e195153-6399-4456-a867-0b5b187456a2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-2e195153-6399-4456-a867-0b5b187456a2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Attempting to detach device tap2e195153-63 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] detach device xml: <interface type="ethernet">
Nov 29 21:48:37 user nova-compute[75206]:   <mac address="fa:16:3e:71:6b:88"/>
Nov 29 21:48:37 user nova-compute[75206]:   <model type="virtio"/>
Nov 29 21:48:37 user nova-compute[75206]:   <mtu size="1442"/>
Nov 29 21:48:37 user nova-compute[75206]:   <target dev="tap2e195153-63"/>
Nov 29 21:48:37 user nova-compute[75206]: </interface>
Nov 29 21:48:37 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 29 21:48:37 user nova-compute[75206]:   <name>instance-00000004</name>
Nov 29 21:48:37 user nova-compute[75206]:   <uuid>852f5aba-96eb-44f4-869a-aa635b6ec7e2</uuid>
Nov 29 21:48:37 user nova-compute[75206]:   <metadata>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:37 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:47:49</nova:creationTime>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:37 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:37 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:37 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:37 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:37 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:37 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:37 user nova-compute[75206]:     <nova:port uuid="2e195153-6399-4456-a867-0b5b187456a2">
Nov 29 21:48:37 user nova-compute[75206]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Nov 29 21:48:37 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:37 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:37 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:37 user nova-compute[75206]:   </metadata>
Nov 29 21:48:37 user nova-compute[75206]:   <memory unit='KiB'>524288</memory>
Nov 29 21:48:37 user nova-compute[75206]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 21:48:37 user nova-compute[75206]:   <vcpu placement='static'>1</vcpu>
Nov 29 21:48:37 user nova-compute[75206]:   <resource>
Nov 29 21:48:37 user nova-compute[75206]:     <partition>/machine</partition>
Nov 29 21:48:37 user nova-compute[75206]:   </resource>
Nov 29 21:48:37 user nova-compute[75206]:   <sysinfo type='smbios'>
Nov 29 21:48:37 user nova-compute[75206]:     <system>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='version'>0.0.0</entry>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='serial'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='uuid'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:37 user nova-compute[75206]:       <entry name='family'>Virtual Machine</entry>
Nov 29 21:48:37 user nova-compute[75206]:     </system>
Nov 29 21:48:37 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:37 user nova-compute[75206]:   <os>
Nov 29 21:48:37 user nova-compute[75206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 21:48:37 user nova-compute[75206]:     <boot dev='hd'/>
Nov 29 21:48:37 user nova-compute[75206]:     <smbios mode='sysinfo'/>
Nov 29 21:48:37 user nova-compute[75206]:   </os>
Nov 29 21:48:37 user nova-compute[75206]:   <features>
Nov 29 21:48:37 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:37 user nova-compute[75206]:     <apic/>
Nov 29 21:48:37 user nova-compute[75206]:     <vmcoreinfo state='on'/>
Nov 29 21:48:37 user nova-compute[75206]:   </features>
Nov 29 21:48:37 user nova-compute[75206]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 21:48:37 user nova-compute[75206]:     <model fallback='forbid'>Nehalem</model>
Nov 29 21:48:37 user nova-compute[75206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 21:48:37 user nova-compute[75206]:     <feature policy='require' name='vme'/>
Nov 29 21:48:37 user nova-compute[75206]:     <feature policy='require' name='x2apic'/>
Nov 29 21:48:37 user nova-compute[75206]:     <feature policy='require' name='hypervisor'/>
Nov 29 21:48:37 user nova-compute[75206]:   </cpu>
Nov 29 21:48:37 user nova-compute[75206]:   <clock offset='utc'>
Nov 29 21:48:37 user nova-compute[75206]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 21:48:37 user nova-compute[75206]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 21:48:37 user nova-compute[75206]:     <timer name='hpet' present='no'/>
Nov 29 21:48:37 user nova-compute[75206]:   </clock>
Nov 29 21:48:37 user nova-compute[75206]:   <on_poweroff>destroy</on_poweroff>
Nov 29 21:48:37 user nova-compute[75206]:   <on_reboot>restart</on_reboot>
Nov 29 21:48:37 user nova-compute[75206]:   <on_crash>destroy</on_crash>
Nov 29 21:48:37 user nova-compute[75206]:   <devices>
Nov 29 21:48:37 user nova-compute[75206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 21:48:37 user nova-compute[75206]:     <disk type='file' device='disk'>
Nov 29 21:48:37 user nova-compute[75206]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 21:48:37 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk' index='2'/>
Nov 29 21:48:37 user nova-compute[75206]:       <backingStore type='file' index='3'>
Nov 29 21:48:37 user nova-compute[75206]:         <format type='raw'/>
Nov 29 21:48:37 user nova-compute[75206]:         <source file='/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212'/>
Nov 29 21:48:37 user nova-compute[75206]:         <backingStore/>
Nov 29 21:48:37 user nova-compute[75206]:       </backingStore>
Nov 29 21:48:37 user nova-compute[75206]:       <target dev='vda' bus='virtio'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='virtio-disk0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </disk>
Nov 29 21:48:37 user nova-compute[75206]:     <disk type='file' device='cdrom'>
Nov 29 21:48:37 user nova-compute[75206]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 21:48:37 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config' index='1'/>
Nov 29 21:48:37 user nova-compute[75206]:       <backingStore/>
Nov 29 21:48:37 user nova-compute[75206]:       <target dev='hda' bus='ide'/>
Nov 29 21:48:37 user nova-compute[75206]:       <readonly/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='ide0-0-0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </disk>
Nov 29 21:48:37 user nova-compute[75206]:     <controller type='usb' index='0' model='none'>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='usb'/>
Nov 29 21:48:37 user nova-compute[75206]:     </controller>
Nov 29 21:48:37 user nova-compute[75206]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='pci.0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </controller>
Nov 29 21:48:37 user nova-compute[75206]:     <controller type='ide' index='0'>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='ide'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 21:48:37 user nova-compute[75206]:     </controller>
Nov 29 21:48:37 user nova-compute[75206]:     <interface type='ethernet'>
Nov 29 21:48:37 user nova-compute[75206]:       <mac address='fa:16:3e:e5:8b:14'/>
Nov 29 21:48:37 user nova-compute[75206]:       <target dev='tapf5c0d0f5-e1'/>
Nov 29 21:48:37 user nova-compute[75206]:       <model type='virtio'/>
Nov 29 21:48:37 user nova-compute[75206]:       <mtu size='1442'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='net0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </interface>
Nov 29 21:48:37 user nova-compute[75206]:     <interface type='ethernet'>
Nov 29 21:48:37 user nova-compute[75206]:       <mac address='fa:16:3e:71:6b:88'/>
Nov 29 21:48:37 user nova-compute[75206]:       <target dev='tap2e195153-63'/>
Nov 29 21:48:37 user nova-compute[75206]:       <model type='virtio'/>
Nov 29 21:48:37 user nova-compute[75206]:       <mtu size='1442'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='net1'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </interface>
Nov 29 21:48:37 user nova-compute[75206]:     <serial type='pty'>
Nov 29 21:48:37 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:37 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:37 user nova-compute[75206]:       <target type='isa-serial' port='0'>
Nov 29 21:48:37 user nova-compute[75206]:         <model name='isa-serial'/>
Nov 29 21:48:37 user nova-compute[75206]:       </target>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </serial>
Nov 29 21:48:37 user nova-compute[75206]:     <console type='pty' tty='/dev/pts/4'>
Nov 29 21:48:37 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:37 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:37 user nova-compute[75206]:       <target type='serial' port='0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </console>
Nov 29 21:48:37 user nova-compute[75206]:     <input type='mouse' bus='ps2'>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='input0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </input>
Nov 29 21:48:37 user nova-compute[75206]:     <input type='keyboard' bus='ps2'>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='input1'/>
Nov 29 21:48:37 user nova-compute[75206]:     </input>
Nov 29 21:48:37 user nova-compute[75206]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 29 21:48:37 user nova-compute[75206]:       <listen type='address' address='0.0.0.0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </graphics>
Nov 29 21:48:37 user nova-compute[75206]:     <audio id='1' type='none'/>
Nov 29 21:48:37 user nova-compute[75206]:     <video>
Nov 29 21:48:37 user nova-compute[75206]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='video0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </video>
Nov 29 21:48:37 user nova-compute[75206]:     <memballoon model='virtio'>
Nov 29 21:48:37 user nova-compute[75206]:       <stats period='10'/>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='balloon0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:37 user nova-compute[75206]:     <rng model='virtio'>
Nov 29 21:48:37 user nova-compute[75206]:       <backend model='random'>/dev/urandom</backend>
Nov 29 21:48:37 user nova-compute[75206]:       <alias name='rng0'/>
Nov 29 21:48:37 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 21:48:37 user nova-compute[75206]:     </rng>
Nov 29 21:48:37 user nova-compute[75206]:   </devices>
Nov 29 21:48:37 user nova-compute[75206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 21:48:37 user nova-compute[75206]:     <label>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</label>
Nov 29 21:48:37 user nova-compute[75206]:     <imagelabel>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</imagelabel>
Nov 29 21:48:37 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:37 user nova-compute[75206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 21:48:37 user nova-compute[75206]:     <label>+64055:+108</label>
Nov 29 21:48:37 user nova-compute[75206]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 21:48:37 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:37 user nova-compute[75206]: </domain>
Nov 29 21:48:37 user nova-compute[75206]:  {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 21:48:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully detached device tap2e195153-63 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the persistent domain config.
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] (1/8): Attempting to detach device tap2e195153-63 with device alias net1 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] detach device xml: <interface type="ethernet">
Nov 29 21:48:37 user nova-compute[75206]:   <mac address="fa:16:3e:71:6b:88"/>
Nov 29 21:48:37 user nova-compute[75206]:   <model type="virtio"/>
Nov 29 21:48:37 user nova-compute[75206]:   <mtu size="1442"/>
Nov 29 21:48:37 user nova-compute[75206]:   <target dev="tap2e195153-63"/>
Nov 29 21:48:37 user nova-compute[75206]: </interface>
Nov 29 21:48:37 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-5a2bbd33-b8b2-4fdb-8a31-70cacb714487 req-cc5e17fd-fbe0-4dda-b710-dfb8a5da3c8f service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Start waiting for the detach event from libvirt for device tap2e195153-63 with device alias net1 for instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc97269a-c177-4179-87e7-e93ab9340fbd req-a5d31035-cb91-477e-b51c-aaa6c87aa88b service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd is timed out.
Nov 29 21:48:38 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully detached device vdb from instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd from the live domain config.
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rOikZjfH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:38 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a7116-51dd-4241-b986-8790e800a8f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:38 user nova-compute[75206]: No targets found.
Nov 29 21:48:38 user nova-compute[75206]: iSNS:
Nov 29 21:48:38 user nova-compute[75206]: No targets found.
Nov 29 21:48:38 user nova-compute[75206]: STATIC:
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635
Nov 29 21:48:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:38 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:38 user nova-compute[75206]: No targets found.
Nov 29 21:48:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:38 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:38 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.066s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7db48-675f-4711-9929-bea0ff1941cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.071s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0252818-ba34-4d50-b9e9-f662e6139adb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:38 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b82035b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635'): ({'sdm'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Removing single pathed devices sdm {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c180b-2853-4e55-8cab-358979543798]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-deleted-f77f981c-9597-4938-98e3-3192df53316d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:38 user nova-compute[75206]: INFO nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Neutron deleted interface f77f981c-9597-4938-98e3-3192df53316d; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.network.neutron [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a291081-f93a-4a78-856c-cc46905f299d", "address": "fa:16:3e:ea:fc:bb", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a291081-f9", "ovs_interfaceid": "0a291081-f93a-4a78-856c-cc46905f299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.063s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6dcb2d-5b9b-4365-9709-e211464291e4]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Flushing IO for device /dev/sdm {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:38 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Instance destroyed successfully.
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lazy-loading 'resources' on Instance uuid a18ab8e4-8948-4de3-bb06-d0b72cedc857 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea0406-97be-4e1f-8702-bbf3eccc1ab8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Detach interface failed, port_id=f77f981c-9597-4938-98e3-3192df53316d, reason: Instance 74a96333-49ef-42c7-9acd-11870a310704 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-deleted-0a291081-f93a-4a78-856c-cc46905f299d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:38 user nova-compute[75206]: INFO nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Neutron deleted interface 0a291081-f93a-4a78-856c-cc46905f299d; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.network.neutron [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [{"id": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "address": "fa:16:3e:d2:f2:0f", "network": {"id": "cc6492bb-95f2-4b27-b465-10e01cd7a5a3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1328645587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9b0d6-7f", "ovs_interfaceid": "e7d9b0d6-7f50-42c4-963e-a33d6118c9c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "084a3081-bd6c-4235-a590-a87f95c6dab4", "address": "fa:16:3e:88:7f:42", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a3081-bd", "ovs_interfaceid": "084a3081-bd6c-4235-a590-a87f95c6dab4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13f0c831-f563-45ca-b5f7-2760710b571c", "address": "fa:16:3e:78:e9:3a", "network": {"id": "ea5a7499-a464-42a6-b1dc-1b0942056028", "bridge": "br-int", "label": "tempest-device-tagging-net1-913693948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13f0c831-f5", "ovs_interfaceid": "13f0c831-f563-45ca-b5f7-2760710b571c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "address": "fa:16:3e:be:ec:5c", "network": {"id": "afc618f5-40e3-4f87-b3d1-0a129f3ef7b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-286101875", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cf157f7c013240258c902914acaabef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99b2e48-9a", "ovs_interfaceid": "d99b2e48-9ad7-4898-88a8-3a58267dfa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ae72bdd-b1, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Detach interface failed, port_id=0a291081-f93a-4a78-856c-cc46905f299d, reason: Instance 74a96333-49ef-42c7-9acd-11870a310704 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-e6ca6e06-9c97-4a9f-9bfb-2022e1f7c969 req-f968c3c7-b7e6-442d-86e3-88f8cd5c8c9e service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.084s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[102e035d-45a9-424a-b078-ae765f18437e]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] SCSI volumes sdm have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26662626437623361', '/dev/disk/by-id/scsi-1SCST_BIOb16005c9-fbbd7b3aaabc9502', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b16005c9') {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 21:48:39 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26662626437623361
Nov 29 21:48:39 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb16005c9-fbbd7b3aaabc9502
Nov 29 21:48:39 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b16005c9
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd89ee6-5db5-48b6-8d88-3b1a2c27aa53]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.098s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef23c04b-29aa-4512-8484-68bf166ef7c0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2832cc96-4819-47f2-8dfa-5b0a9edc47f4) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --logout" returned: 0 in 0.178s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c94047a-bb58-4140-a9a3-06132ec7ffc2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260]
Nov 29 21:48:39 user nova-compute[75206]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:39 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca47f351-bcf3-4806-991a-6d62f2062635 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf41c9-6de6-432d-a73f-4a06c87e06ef]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.835s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] <== disconnect_volume: return (837ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4d:cb,bridge_name='br-int',has_traffic_filtering=True,id=2ae72bdd-b11b-485f-9c2a-88a8be974699,network=Network(d90122a0-8776-4058-a440-8cd4ab1a1e83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae72bdd-b1')
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap726c22fc-0b, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1256253c-3d02-4d44-b63e-d0f6df061d97) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a8:5c,bridge_name='br-int',has_traffic_filtering=True,id=726c22fc-0bba-46ca-a41a-7f92ebd434d0,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap726c22fc-0b')
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc08a3488-a0, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:39 user nova-compute[75206]: WARNING nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-2ae72bdd-b11b-485f-9c2a-88a8be974699 for instance with vm_state active and task_state deleting.
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-ff7c39d7-961d-4693-a004-2b36c4646f75 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:39 user nova-compute[75206]: WARNING nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-ff7c39d7-961d-4693-a004-2b36c4646f75 for instance with vm_state active and task_state deleting.
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-unplugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-unplugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:39 user nova-compute[75206]: WARNING nova.compute.manager [req-66660b79-d254-46a8-a5ec-bd6392143864 req-1de872d7-7718-4806-aed2-f7d7467219f7 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-unplugged-2e195153-6399-4456-a867-0b5b187456a2 for instance with vm_state active and task_state None.
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a6e6a67-eced-4393-9155-c63ac8dfb74f) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b5:1a,bridge_name='br-int',has_traffic_filtering=True,id=c08a3488-a024-4638-9e4a-cff2dc77a6f8,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc08a3488-a0')
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff7c39d7-96, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=708a27ab-1b71-4904-9412-065ed0099a29) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:da:e8,bridge_name='br-int',has_traffic_filtering=True,id=ff7c39d7-961d-4693-a004-2b36c4646f75,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff7c39d7-96')
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdaa3e53-1e, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55cb392b-8b88-414d-b152-354c891f1e77) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:b6:13,bridge_name='br-int',has_traffic_filtering=True,id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381,network=Network(3e5106d1-1278-442b-885c-2a892fbb2c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdaa3e53-1e')
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb356aaa-5e, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb107f6e-b49c-4940-bb95-c3ebe8bc0218) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:57:0a,bridge_name='br-int',has_traffic_filtering=True,id=eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb356aaa-5e')
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1697802926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1697802926',id=12,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQ6BHk5vMJPZgKe6QoCEH5eAeLthR7/Q4HfLd/MSWeLQcQ1MRITbmsDyuZHxCLJy8JQn0CAC6IttwiyBmWQtay6oWi3ytouT/yVAIcu8wmt/D4AIEAN92chNSE4YTocA==',key_name='tempest-keypair-194775541',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de865030aefa4a62972e7c5f2f3c258d',ramdisk_id='',reservation_id='r-l2ak0ekz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1499903624',owner_user_name='tempest-TaggedBootDevicesTest_v242-1499903624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efb35e952c3f47e4bc10724200fa2200',uuid=a18ab8e4-8948-4de3-bb06-d0b72cedc857,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converting VIF {"id": "e9af5315-3950-43e0-9633-84ac4b24859f", "address": "fa:16:3e:a4:d4:04", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9af5315-39", "ovs_interfaceid": "e9af5315-3950-43e0-9633-84ac4b24859f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9af5315-39, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=116d2edc-2b30-4422-afb2-580a27509f29) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:40 user nova-compute[75206]: INFO os_vif [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d4:04,bridge_name='br-int',has_traffic_filtering=True,id=e9af5315-3950-43e0-9633-84ac4b24859f,network=Network(b2f7cc45-d27c-4f09-bc85-eae3bcded968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9af5315-39')
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-726c22fc-0bba-46ca-a41a-7f92ebd434d0 for instance with vm_state active and task_state deleting.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d for instance with vm_state active and task_state deleting.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-e9af5315-3950-43e0-9633-84ac4b24859f for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.compute.manager [req-b0f2c4f9-08fe-4aba-a689-23b9879ecf1a req-fa56ed63-6fb3-4732-a2ac-ad21c9b73a9c service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-e9af5315-3950-43e0-9633-84ac4b24859f for instance with vm_state active and task_state deleting.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXkaPUOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6f0ce9-4e16-4eae-8e81-bf6facc9303c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: iSNS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: STATIC:
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:40 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab844c70-42ed-40a1-9f2c-8feced3bfadb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be4833-fc38-4097-94bd-88596caddb30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c836bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09'): ({'sdf'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Removing single pathed devices sdf {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:40 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Took 6.03 seconds to deallocate network for instance.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[812788b2-8bf9-4865-b3aa-8a6a6b4225cc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76e76c7-2332-4318-bebd-57005588c378]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Flushing IO for device /dev/sdf {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a202c70c-06c1-40e7-8c70-3f630b141bc6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b591b5dc-f459-4071-bc2a-277610d97ecc is timed out.
Nov 29 21:48:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Successfully detached device sdc from instance b591b5dc-f459-4071-bc2a-277610d97ecc from the live domain config.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUtbAuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdn'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ee7912-4863-4600-aafd-0533e937e724]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a11ce-47dd-4791-b242-b9325032e165]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.objects.instance [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'flavor' on Instance uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92a731c9-6221-4f5a-9d4b-3ec7bab17cbb tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.667s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbba801-735b-47d5-bd33-1bbb36e7c6ba]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260]
Nov 29 21:48:40 user nova-compute[75206]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a03be09-3da5-4c04-89f9-7ce188ca9a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc03487-af17-4572-8bf1-94e20bec6fad]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== disconnect_volume: return (413ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.200s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbJoVfED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e243dc-e83d-443f-a59f-082050518e00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: iSNS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: STATIC:
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:40 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6331773-e9ee-4614-a568-c0b68f4742e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da245416-f078-457b-8e4f-284180c19ef7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:40 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d2bcde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7'): ({'sdn'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Removing single pathed devices sdn {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14490dd9-769e-4fa9-9b7e-d7407c986a92]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdn" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55897cde-36d7-4b82-9b69-f35b69f67c02]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Flushing IO for device /dev/sdn {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdn" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcecd9d-5244-46f7-996a-c8f329a6488e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdn/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdn/device/delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e33c00-3ae8-411b-a75a-f09bd2953ace]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Checking to see if SCSI volumes sdn have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] SCSI volumes sdn have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[645efa0e-6cd8-4d26-918e-13039a717f55]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[803226eb-bdfc-47ec-a454-8f5509171dc0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260]
Nov 29 21:48:40 user nova-compute[75206]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5becc4e-523d-4bbf-92c9-07b21d4788c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[386401ec-c359-4cd2-8b4d-de85ad1efbf1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] <== disconnect_volume: return (583ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.383s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a46c5d-6e3c-42e8-a950-c4e36aeff054]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: iSNS:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]: STATIC:
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:40 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:40 user nova-compute[75206]: No targets found.
Nov 29 21:48:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:40 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:40 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-c08a3488-a024-4638-9e4a-cff2dc77a6f8 for instance with vm_state active and task_state deleting.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-unplugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-unplugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-deleted-e7d9b0d6-7f50-42c4-963e-a33d6118c9c5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Acquiring lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] No waiting events found dispatching network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:40 user nova-compute[75206]: WARNING nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received unexpected event network-vif-plugged-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 for instance with vm_state active and task_state deleting.
Nov 29 21:48:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e96084d-51a7-4f30-b161-157d7e261e5c req-6a529e39-7309-4018-ba70-049c5e73ccdb service nova] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Received event network-vif-deleted-d99b2e48-9ad7-4898-88a8-3a58267dfa7e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea113f68-9675-4ac0-88dd-5d4f7ddc9d08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61024875-c889-402a-9e12-16e927e99ffd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8488670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4'): ({'sdg'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Removing single pathed devices sdg {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39cc5d-f4bc-431c-92f0-7880f3be0cf2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e05454f-9cd8-4cdb-97bd-d86383802704]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Flushing IO for device /dev/sdg {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[483c6df4-105c-40b1-8e60-5098d6f45f32]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f15feeb-5a9b-4dca-9705-1c61832e1666]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaf2d71-64a9-4188-bcf7-a9cb1613ad60]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83504c28-ddb1-4c9b-a1a0-72f8875e8cd4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260]
Nov 29 21:48:41 user nova-compute[75206]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186effb7-edce-429e-8f1d-e15d76d589e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22a97b-be72-4c78-976a-032066a6c128]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== disconnect_volume: return (731ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCKytVbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:41 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be0a94-08b8-40ea-8e00-ca4f4dcef2ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:41 user nova-compute[75206]: No targets found.
Nov 29 21:48:41 user nova-compute[75206]: iSNS:
Nov 29 21:48:41 user nova-compute[75206]: No targets found.
Nov 29 21:48:41 user nova-compute[75206]: STATIC:
Nov 29 21:48:41 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:41 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:41 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:41 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b
Nov 29 21:48:41 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:41 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:41 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:41 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:41 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:41 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:41 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:41 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:41 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:41 user nova-compute[75206]: No targets found.
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:41 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:41 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4898318-4298-443a-ba42-40b0de3ece0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbad8ad-94d0-42f1-9734-b3ed9726a30e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:41 user nova-compute[75206]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b (non-flash)
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b82012d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b'): ({'sdh'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Removing single pathed devices sdh {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[65733bc2-b568-452c-8c37-f98e69e26275]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8e2ad-eb61-45a3-ba4e-c0db07be8cf9]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Flushing IO for device /dev/sdh {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888bfef-bf4c-4414-b0d1-6fd8a9716731]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[298fdc84-2981-4693-aa0a-4fd108aa3cca]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] SCSI volumes sdh have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61900c-a502-4bb3-90e2-4b8f802a8b59]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd88f91-c400-4e92-b32d-f5b6b9dd97c0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260]
Nov 29 21:48:41 user nova-compute[75206]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:41 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f385abf-7b9e-4f5c-867e-c23c1d84209b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3aa9df-e755-49f2-980d-da120f49e523]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] <== disconnect_volume: return (337ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Deleting instance files /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857_del
Nov 29 21:48:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Deletion of /opt/stack/data/nova/instances/a18ab8e4-8948-4de3-bb06-d0b72cedc857_del complete
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:41 user nova-compute[75206]: WARNING nova.compute.manager [req-bd8fc8e3-5ddc-4141-a032-b637115dbb5e req-8f4cd63b-ea55-4aac-a05e-8874ca56aeef service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-2e195153-6399-4456-a867-0b5b187456a2 for instance with vm_state active and task_state None.
Nov 29 21:48:41 user nova-compute[75206]: INFO nova.compute.manager [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Took 4.86 seconds to destroy the instance on the hypervisor.
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lazy-loading 'flavor' on Instance uuid b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d771785-0949-42f8-a063-a03ed5200d93 tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.283s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '2811f030-59f9-4d41-9319-6990514fc417', 'serial': '2811f030-59f9-4d41-9319-6990514fc417'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74'}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74', 'serial'} {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:42 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf79058c-20c0-4a63-b835-97cbdf3b51ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:48:42 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e4195-e644-4a2a-8b93-b0e32dcb8477]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417] added
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8b616-c6ef-4040-ba2c-310b2427ec0c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2731dc8-358a-4d97-96fe-f111fad16aac]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JELjxyDX {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JELjxyDX" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b791e4-1bc7-41ed-9711-108043b3a301]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JELjxyDX'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd46a0f0-3257-4b8b-816c-58207e98b74d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f97edaf-59b9-4662-b34c-1049cc3cb8df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:42 user nova-compute[75206]: INFO nova.compute.manager [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Terminating instance
Nov 29 21:48:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6df80d5-4219-4850-a229-ee2e3cbfd708]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]
Nov 29 21:48:42 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1210d-4242-4c49-b217-1893d8b79cc3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8c6c7-70f8-415e-a01d-d5a078e37f01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda599ab-8b22-4bea-bbc5-fd984e72d70f]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-unplugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] No waiting events found dispatching network-vif-unplugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-2f0e8fe2-e2d4-4427-8e7b-308e05bcf5ab req-dcbf5311-dced-445f-b558-21d1be1972a5 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-unplugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:48:42 user nova-compute[75206]: INFO nova.compute.manager [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] [instance: 74a96333-49ef-42c7-9acd-11870a310704] Took 2.67 seconds to detach 3 volumes for instance.
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Instance destroyed successfully.
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lazy-loading 'resources' on Instance uuid b591b5dc-f459-4071-bc2a-277610d97ecc {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-462603799',display_name='tempest-AttachSCSIVolumeTestJSON-server-462603799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-462603799',id=6,image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4wXi47ahEh75OpMFnFRGsTGREey9q49VK7np4/Ke3PySHP7IRyUuwFVigKvq17vGagrs4eH1De0yID7P0bDM+tJLRm31uHrEpi7c7zJHu/W/xEuL30ci8a1vOVwFJKGA==',key_name='tempest-keypair-1368523522',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba8e0f56957248c2b4e7b648c207dcab',ramdisk_id='',reservation_id='r-1c44ng8s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac67ac1c-c324-40f4-85cf-11f8ae86e502',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1815242500',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1815242500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6b1dbe668dd4f16801a8b19bcb3fc5b',uuid=b591b5dc-f459-4071-bc2a-277610d97ecc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converting VIF {"id": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "address": "fa:16:3e:09:ee:f5", "network": {"id": "377d4c36-06f0-4909-a270-a680471da033", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-683962855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba8e0f56957248c2b4e7b648c207dcab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3889f06-a7", "ovs_interfaceid": "a3889f06-a7d3-4fb9-ac39-2338a5e175d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG os_vif [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3889f06-a7, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b40b0b9-83ee-47fa-a78c-cc75f510bb05) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:43 user nova-compute[75206]: INFO os_vif [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:ee:f5,bridge_name='br-int',has_traffic_filtering=True,id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4,network=Network(377d4c36-06f0-4909-a270-a680471da033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3889f06-a7')
Nov 29 21:48:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Deleting instance files /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc_del
Nov 29 21:48:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Deletion of /opt/stack/data/nova/instances/b591b5dc-f459-4071-bc2a-277610d97ecc_del complete
Nov 29 21:48:43 user nova-compute[75206]: INFO nova.compute.manager [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 21:48:43 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:43 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Deleted allocations for instance 74a96333-49ef-42c7-9acd-11870a310704
Nov 29 21:48:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26436393335613937', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436393335613937', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lazy-loading 'flavor' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-17bae110-4c8b-43b5-8b13-83b6a2fa1c0d tempest-TaggedBootDevicesTest-983513582 tempest-TaggedBootDevicesTest-983513582-project-member] Lock "74a96333-49ef-42c7-9acd-11870a310704" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.237s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:44 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Took 1.33 seconds to deallocate network for instance.
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-cbdf0edc-f08a-4de8-b139-babe6398bfb8 req-bfd1d4c8-0975-4d8f-acb6-4fe926f178c2 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-deleted-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:44 user nova-compute[75206]: INFO nova.compute.manager [req-cbdf0edc-f08a-4de8-b139-babe6398bfb8 req-bfd1d4c8-0975-4d8f-acb6-4fe926f178c2 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Neutron deleted interface a3889f06-a7d3-4fb9-ac39-2338a5e175d4; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.network.neutron [req-cbdf0edc-f08a-4de8-b139-babe6398bfb8 req-bfd1d4c8-0975-4d8f-acb6-4fe926f178c2 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-cbdf0edc-f08a-4de8-b139-babe6398bfb8 req-bfd1d4c8-0975-4d8f-acb6-4fe926f178c2 service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Detach interface failed, port_id=a3889f06-a7d3-4fb9-ac39-2338a5e175d4, reason: Instance b591b5dc-f459-4071-bc2a-277610d97ecc could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] Acquiring lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] No waiting events found dispatching network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:44 user nova-compute[75206]: WARNING nova.compute.manager [req-49be7bb7-f61e-4186-838c-c5f5cf6d7f8a req-ef448ab3-d6be-4907-9d0a-a19bc895a5ee service nova] [instance: b591b5dc-f459-4071-bc2a-277610d97ecc] Received unexpected event network-vif-plugged-a3889f06-a7d3-4fb9-ac39-2338a5e175d4 for instance with vm_state active and task_state deleting.
Nov 29 21:48:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:45 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:45 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Deleted allocations for instance b591b5dc-f459-4071-bc2a-277610d97ecc
Nov 29 21:48:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 271581184 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c2e9b4d-6a2b-457c-b571-948f27592eaa tempest-AttachSCSIVolumeTestJSON-1815242500 tempest-AttachSCSIVolumeTestJSON-1815242500-project-member] Lock "b591b5dc-f459-4071-bc2a-277610d97ecc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.233s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 382730240 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 544210944 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-deleted-e9af5315-3950-43e0-9633-84ac4b24859f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:46 user nova-compute[75206]: INFO nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Neutron deleted interface e9af5315-3950-43e0-9633-84ac4b24859f; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff7c39d7-961d-4693-a004-2b36c4646f75", "address": "fa:16:3e:ad:da:e8", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff7c39d7-96", "ovs_interfaceid": "ff7c39d7-961d-4693-a004-2b36c4646f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Detach interface failed, port_id=e9af5315-3950-43e0-9633-84ac4b24859f, reason: Instance a18ab8e4-8948-4de3-bb06-d0b72cedc857 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-deleted-ff7c39d7-961d-4693-a004-2b36c4646f75 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:46 user nova-compute[75206]: INFO nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Neutron deleted interface ff7c39d7-961d-4693-a004-2b36c4646f75; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "address": "fa:16:3e:c3:b6:13", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdaa3e53-1e", "ovs_interfaceid": "cdaa3e53-1ed8-4709-91ee-2bddd60e6381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Detach interface failed, port_id=ff7c39d7-961d-4693-a004-2b36c4646f75, reason: Instance a18ab8e4-8948-4de3-bb06-d0b72cedc857 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-deleted-cdaa3e53-1ed8-4709-91ee-2bddd60e6381 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:46 user nova-compute[75206]: INFO nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Neutron deleted interface cdaa3e53-1ed8-4709-91ee-2bddd60e6381; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [{"id": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "address": "fa:16:3e:14:4d:cb", "network": {"id": "d90122a0-8776-4058-a440-8cd4ab1a1e83", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1239688904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae72bdd-b1", "ovs_interfaceid": "2ae72bdd-b11b-485f-9c2a-88a8be974699", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "address": "fa:16:3e:6b:a8:5c", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726c22fc-0b", "ovs_interfaceid": "726c22fc-0bba-46ca-a41a-7f92ebd434d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "address": "fa:16:3e:fb:b5:1a", "network": {"id": "3e5106d1-1278-442b-885c-2a892fbb2c5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1183630136", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc08a3488-a0", "ovs_interfaceid": "c08a3488-a024-4638-9e4a-cff2dc77a6f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "address": "fa:16:3e:01:57:0a", "network": {"id": "b2f7cc45-d27c-4f09-bc85-eae3bcded968", "bridge": "br-int", "label": "tempest-device-tagging-net2-782531521", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de865030aefa4a62972e7c5f2f3c258d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb356aaa-5e", "ovs_interfaceid": "eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-349508e8-7b07-49ec-bfec-1baa719d3f7d req-2d10e7e2-8cec-495d-be0e-bb4dbd232607 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Detach interface failed, port_id=cdaa3e53-1ed8-4709-91ee-2bddd60e6381, reason: Instance a18ab8e4-8948-4de3-bb06-d0b72cedc857 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:48:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 702545920 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:47 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:47 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Took 6.14 seconds to deallocate network for instance.
Nov 29 21:48:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 944766976 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:48 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e is timed out.
Nov 29 21:48:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Successfully detached device vdb from instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e from the live domain config.
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IikXwQYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:48 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8a601a-8729-4b51-b30a-5a191024ee6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:48 user nova-compute[75206]: No targets found.
Nov 29 21:48:48 user nova-compute[75206]: iSNS:
Nov 29 21:48:48 user nova-compute[75206]: No targets found.
Nov 29 21:48:48 user nova-compute[75206]: STATIC:
Nov 29 21:48:48 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:48 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:48 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:48 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:48 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:48 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:48 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:48 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:48 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:48 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68
Nov 29 21:48:48 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:48 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:48 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:48 user nova-compute[75206]: No targets found.
Nov 29 21:48:48 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:48 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:48 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589c179-038a-410c-9a82-9fe5f6e31a76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02e488-8d4d-47eb-aa67-a757347669f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:48 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8466c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04220df0-a8ba-4f30-8762-ab1d5a590c53]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e131dd9d-316e-4432-b73a-9fa20fe0c339]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4811a-a8a9-420c-b71c-18e64e23b0df]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f521fb-3535-49d7-9fbc-53f8f3f16e3d]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[507eaeed-4edd-4967-8b0e-7d59d79b55a2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 1039138816 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02158c-3b61-42f8-abc0-67ecfdbbcca2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260]
Nov 29 21:48:48 user nova-compute[75206]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:48 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd7b1469-387a-4394-a0e2-6583b6347c68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46cc08b-dd75-4cee-997f-1c5aa69c12f1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] <== disconnect_volume: return (336ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-583856de-aef5-4fba-81d7-2cd0a49bfdc9 req-3620521e-2e04-4684-a5b1-3f492897c266 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-deleted-eb356aaa-5e79-45ff-a6ea-a6e67ee9da2d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-583856de-aef5-4fba-81d7-2cd0a49bfdc9 req-3620521e-2e04-4684-a5b1-3f492897c266 service nova] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Received event network-vif-deleted-2ae72bdd-b11b-485f-9c2a-88a8be974699 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAFkWQZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '72603443-3115-438a-b1ee-7547e2a1cf74'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:48:49 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc1897c-8b8e-4487-ab6a-08d1cf8869ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:48:49 user nova-compute[75206]: No targets found.
Nov 29 21:48:49 user nova-compute[75206]: iSNS:
Nov 29 21:48:49 user nova-compute[75206]: No targets found.
Nov 29 21:48:49 user nova-compute[75206]: STATIC:
Nov 29 21:48:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:48:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74
Nov 29 21:48:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:48:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:48:49 user nova-compute[75206]: FIRMWARE:
Nov 29 21:48:49 user nova-compute[75206]: No targets found.
Nov 29 21:48:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:48:49 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:48:49 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10324cf2-c5ab-42d3-a270-1cac5cb4aaa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b4fe09-50a8-48c5-a4a8-ff26a24f729b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:48:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c83cce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74'): ({'sdl'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Removing single pathed devices sdl {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808863d-b915-49e0-977c-a29f9a8de9be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[200fed3e-3440-469c-9def-176fc31bed38]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Flushing IO for device /dev/sdl {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c506f0a-639f-43a5-8a99-de698878982b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[874013ca-4ea2-4e3b-82b0-be6672be43aa]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] SCSI volumes sdl have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a026f7-4159-4fed-8fd6-387c7b9e5002]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0133960-5a28-4276-a3b0-44d1d98acf03]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260]
Nov 29 21:48:49 user nova-compute[75206]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74, portal: 172.16.0.220,3260] successful.
Nov 29 21:48:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72603443-3115-438a-b1ee-7547e2a1cf74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f3eae9-9204-423e-8e8d-adec6659b19c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] <== disconnect_volume: return (304ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6f335e0e-1ba6-428d-9aab-1f05d6ff18b0', 'attached_at': '', 'detached_at': '', 'volume_id': '2811f030-59f9-4d41-9319-6990514fc417', 'serial'} {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 21:48:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: removing Cinder connection for volume 72603443-3115-438a-b1ee-7547e2a1cf74 {{(pid=75206) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 21:48:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lazy-loading 'flavor' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0baeac73-b5b3-4563-a8ac-2ee94040fc2e tempest-VolumesAssistedSnapshotsTest-719393517 tempest-VolumesAssistedSnapshotsTest-719393517-project-admin] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.604s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.compute.claims [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Claim successful on node user
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] swap_volume: Updating volume 72603443-3115-438a-b1ee-7547e2a1cf74 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JELjxyDX", "auth_password": "ORj9DoNpnUqsWm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "2811f030-59f9-4d41-9319-6990514fc417"}, "status": "reserved", "instance": "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0", "attached_at": "", "detached_at": "", "volume_id": "2811f030-59f9-4d41-9319-6990514fc417", "serial": "2811f030-59f9-4d41-9319-6990514fc417"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2811f030-59f9-4d41-9319-6990514fc417', 'no_device': None, 'attachment_id': 'b37d10a7-46f2-4bb4-b22d-bb2b06af84b0'} {{(pid=75206) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5451ddfa-d7f6-4a56-8b51-916956e65295 tempest-TestVolumeSwap-396167369 tempest-TestVolumeSwap-396167369-project-admin] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 29.500s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.199s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.compute.claims [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Claim successful on node user
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.compute.manager [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Detaching volume 2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.policy [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '656a5b2470e14813b3060d41b1d61095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa0640f6b84a71b856782e45ca4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.virt.block_device [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Attempting to driver detach volume 2811f030-59f9-4d41-9319-6990514fc417 from mountpoint /dev/vdb
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Attempting to detach device vdb from instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:51 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:51 user nova-compute[75206]:   <source dev="/dev/sdc"/>
Nov 29 21:48:51 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:51 user nova-compute[75206]:   <serial>2811f030-59f9-4d41-9319-6990514fc417</serial>
Nov 29 21:48:51 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:51 user nova-compute[75206]: </disk>
Nov 29 21:48:51 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Successfully detached device vdb from instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 from the persistent domain config.
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:48:51 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:48:51 user nova-compute[75206]:   <source dev="/dev/sdc"/>
Nov 29 21:48:51 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:48:51 user nova-compute[75206]:   <serial>2811f030-59f9-4d41-9319-6990514fc417</serial>
Nov 29 21:48:51 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:48:51 user nova-compute[75206]: </disk>
Nov 29 21:48:51 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:48:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Creating image(s)
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "/opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:52 user nova-compute[75206]: INFO nova.compute.manager [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] [instance: a18ab8e4-8948-4de3-bb06-d0b72cedc857] Took 4.31 seconds to detach 3 volumes for instance.
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk 1073741824" returned: 0 in 0.060s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Successfully created port: ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:48:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.policy [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0e5aeaa21d7401eb7aa308f258ba9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a2d0b7649174bcc950c52daf296b504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:48:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Creating image(s)
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "/opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "/opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Cannot resize image /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Ensure instance console log exists: /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.700s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:53 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Deleted allocations for instance a18ab8e4-8948-4de3-bb06-d0b72cedc857
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk 1073741824" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3050ecd6-0306-4429-9ad3-5fb8afa52d6b tempest-TaggedBootDevicesTest_v242-1499903624 tempest-TaggedBootDevicesTest_v242-1499903624-project-member] Lock "a18ab8e4-8948-4de3-bb06-d0b72cedc857" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.551s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Successfully created port: 5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Cannot resize image /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Ensure instance console log exists: /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Successfully updated port: ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing instance network info cache due to event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing network info cache for port ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f6abf4f-bf69-4fa9-bf9f-b7685bee5f6a req-296d25a1-583b-4c66-a05b-3b1fb1c42019 service nova] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Successfully updated port: 5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquired lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance network_info: |[{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Start _get_guest_xml network_info=[{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:48:54 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:54 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2055333954',display_name='tempest-ServerActionsTestOtherA-server-2055333954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2055333954',id=14,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-xisu8ic0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=b42a980d-ff5c-4afb-82ab-edef2a55512f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'pci_devices' on Instance uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:48:54 user nova-compute[75206]:   <uuid>b42a980d-ff5c-4afb-82ab-edef2a55512f</uuid>
Nov 29 21:48:54 user nova-compute[75206]:   <name>instance-0000000e</name>
Nov 29 21:48:54 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:48:54 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:48:54 user nova-compute[75206]:   <metadata>
Nov 29 21:48:54 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:54 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherA-server-2055333954</nova:name>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:48:54</nova:creationTime>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:48:54 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:54 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:owner>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:user uuid="656a5b2470e14813b3060d41b1d61095">tempest-ServerActionsTestOtherA-2043072317-project-member</nova:user>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:project uuid="feaa0640f6b84a71b856782e45ca4adf">tempest-ServerActionsTestOtherA-2043072317</nova:project>
Nov 29 21:48:54 user nova-compute[75206]:       </nova:owner>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:54 user nova-compute[75206]:       <nova:ports>
Nov 29 21:48:54 user nova-compute[75206]:         <nova:port uuid="ad856788-4434-42d5-b2c1-dfd545ff286f">
Nov 29 21:48:54 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 21:48:54 user nova-compute[75206]:         </nova:port>
Nov 29 21:48:54 user nova-compute[75206]:       </nova:ports>
Nov 29 21:48:54 user nova-compute[75206]:     </nova:instance>
Nov 29 21:48:54 user nova-compute[75206]:   </metadata>
Nov 29 21:48:54 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:48:54 user nova-compute[75206]:     <system>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="serial">b42a980d-ff5c-4afb-82ab-edef2a55512f</entry>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="uuid">b42a980d-ff5c-4afb-82ab-edef2a55512f</entry>
Nov 29 21:48:54 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:48:54 user nova-compute[75206]:     </system>
Nov 29 21:48:54 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:54 user nova-compute[75206]:   <os>
Nov 29 21:48:54 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:48:54 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:48:54 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:48:54 user nova-compute[75206]:   </os>
Nov 29 21:48:54 user nova-compute[75206]:   <features>
Nov 29 21:48:54 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:54 user nova-compute[75206]:     <apic/>
Nov 29 21:48:54 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:48:54 user nova-compute[75206]:   </features>
Nov 29 21:48:54 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:48:54 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:48:54 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:48:54 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:48:54 user nova-compute[75206]:   </clock>
Nov 29 21:48:54 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:48:54 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:48:54 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:48:54 user nova-compute[75206]:   </cpu>
Nov 29 21:48:54 user nova-compute[75206]:   <devices>
Nov 29 21:48:54 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:48:54 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:48:54 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk"/>
Nov 29 21:48:54 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:48:54 user nova-compute[75206]:     </disk>
Nov 29 21:48:54 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:48:54 user nova-compute[75206]:       <mac address="fa:16:3e:96:f9:81"/>
Nov 29 21:48:54 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:54 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:48:54 user nova-compute[75206]:       <target dev="tapad856788-44"/>
Nov 29 21:48:54 user nova-compute[75206]:     </interface>
Nov 29 21:48:54 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:48:54 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/console.log" append="off"/>
Nov 29 21:48:54 user nova-compute[75206]:     </serial>
Nov 29 21:48:54 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:48:54 user nova-compute[75206]:     <video>
Nov 29 21:48:54 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:54 user nova-compute[75206]:     </video>
Nov 29 21:48:54 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:48:54 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:48:54 user nova-compute[75206]:     </rng>
Nov 29 21:48:54 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:48:54 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:48:54 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:48:54 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:54 user nova-compute[75206]:   </devices>
Nov 29 21:48:54 user nova-compute[75206]: </domain>
Nov 29 21:48:54 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2055333954',display_name='tempest-ServerActionsTestOtherA-server-2055333954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2055333954',id=14,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-xisu8ic0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=b42a980d-ff5c-4afb-82ab-edef2a55512f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG os_vif [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7482ab9-686a-5845-8e99-16b1b3aa6edc', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad856788-44, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad856788-44, col_values=(('qos', UUID('5341f9c7-666a-4e51-8a3e-95e872e66632')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad856788-44, col_values=(('external_ids', {'iface-id': 'ad856788-4434-42d5-b2c1-dfd545ff286f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f9:81', 'vm-uuid': 'b42a980d-ff5c-4afb-82ab-edef2a55512f'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: INFO os_vif [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44')
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:96:f9:81, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Updating instance_info_cache with network_info: [{"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Releasing lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Instance network_info: |[{"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Start _get_guest_xml network_info=[{"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:48:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1813080560',display_name='tempest-VolumesActionsTest-instance-1813080560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1813080560',id=15,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-9qr0bxxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:53Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=7bc18f3e-d5cb-4653-91e7-766c0360c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bc18f3e-d5cb-4653-91e7-766c0360c047 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:48:55 user nova-compute[75206]:   <uuid>7bc18f3e-d5cb-4653-91e7-766c0360c047</uuid>
Nov 29 21:48:55 user nova-compute[75206]:   <name>instance-0000000f</name>
Nov 29 21:48:55 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:48:55 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:48:55 user nova-compute[75206]:   <metadata>
Nov 29 21:48:55 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:55 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:name>tempest-VolumesActionsTest-instance-1813080560</nova:name>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:48:55</nova:creationTime>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:48:55 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:55 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:owner>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:user uuid="c0e5aeaa21d7401eb7aa308f258ba9b5">tempest-VolumesActionsTest-1514528984-project-member</nova:user>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:project uuid="3a2d0b7649174bcc950c52daf296b504">tempest-VolumesActionsTest-1514528984</nova:project>
Nov 29 21:48:55 user nova-compute[75206]:       </nova:owner>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:55 user nova-compute[75206]:       <nova:ports>
Nov 29 21:48:55 user nova-compute[75206]:         <nova:port uuid="5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1">
Nov 29 21:48:55 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 21:48:55 user nova-compute[75206]:         </nova:port>
Nov 29 21:48:55 user nova-compute[75206]:       </nova:ports>
Nov 29 21:48:55 user nova-compute[75206]:     </nova:instance>
Nov 29 21:48:55 user nova-compute[75206]:   </metadata>
Nov 29 21:48:55 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:48:55 user nova-compute[75206]:     <system>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="serial">7bc18f3e-d5cb-4653-91e7-766c0360c047</entry>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="uuid">7bc18f3e-d5cb-4653-91e7-766c0360c047</entry>
Nov 29 21:48:55 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:48:55 user nova-compute[75206]:     </system>
Nov 29 21:48:55 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:55 user nova-compute[75206]:   <os>
Nov 29 21:48:55 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:48:55 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:48:55 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:48:55 user nova-compute[75206]:   </os>
Nov 29 21:48:55 user nova-compute[75206]:   <features>
Nov 29 21:48:55 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:55 user nova-compute[75206]:     <apic/>
Nov 29 21:48:55 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:48:55 user nova-compute[75206]:   </features>
Nov 29 21:48:55 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:48:55 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:48:55 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:48:55 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:48:55 user nova-compute[75206]:   </clock>
Nov 29 21:48:55 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:48:55 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:48:55 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:48:55 user nova-compute[75206]:   </cpu>
Nov 29 21:48:55 user nova-compute[75206]:   <devices>
Nov 29 21:48:55 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:48:55 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:48:55 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk"/>
Nov 29 21:48:55 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:48:55 user nova-compute[75206]:     </disk>
Nov 29 21:48:55 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:48:55 user nova-compute[75206]:       <mac address="fa:16:3e:43:9e:d2"/>
Nov 29 21:48:55 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:55 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:48:55 user nova-compute[75206]:       <target dev="tap5e6c3c57-2c"/>
Nov 29 21:48:55 user nova-compute[75206]:     </interface>
Nov 29 21:48:55 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:48:55 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/console.log" append="off"/>
Nov 29 21:48:55 user nova-compute[75206]:     </serial>
Nov 29 21:48:55 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:48:55 user nova-compute[75206]:     <video>
Nov 29 21:48:55 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:48:55 user nova-compute[75206]:     </video>
Nov 29 21:48:55 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:48:55 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:48:55 user nova-compute[75206]:     </rng>
Nov 29 21:48:55 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:48:55 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:48:55 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:48:55 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:55 user nova-compute[75206]:   </devices>
Nov 29 21:48:55 user nova-compute[75206]: </domain>
Nov 29 21:48:55 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1813080560',display_name='tempest-VolumesActionsTest-instance-1813080560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1813080560',id=15,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-9qr0bxxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:48:53Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=7bc18f3e-d5cb-4653-91e7-766c0360c047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG os_vif [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8a6261b-45a6-507c-9c8f-bcd2a06e4383', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e6c3c57-2c, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e6c3c57-2c, col_values=(('qos', UUID('4cbd2721-0cbe-4e4d-94a4-68ce28d1bdee')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e6c3c57-2c, col_values=(('external_ids', {'iface-id': '5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:9e:d2', 'vm-uuid': '7bc18f3e-d5cb-4653-91e7-766c0360c047'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:55 user nova-compute[75206]: INFO os_vif [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c')
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:48:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] No VIF found with MAC fa:16:3e:43:9e:d2, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-changed-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Refreshing instance network info cache due to event network-changed-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] Acquiring lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] Acquired lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Refreshing network info cache for port 5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Updated VIF entry in instance network info cache for port 5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Updating instance_info_cache with network_info: [{"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa912e1f-d3f6-4e66-86a7-5ad96f310e8a req-cda444cf-a4f5-4d52-b8ce-2c3aa63dce59 service nova] Releasing lock "refresh_cache-7bc18f3e-d5cb-4653-91e7-766c0360c047" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] No waiting events found dispatching network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:57 user nova-compute[75206]: WARNING nova.compute.manager [req-bd7bba19-34dc-4ad1-8ee7-563ebee21034 req-946e3309-4bb1-4c73-9659-75193d067b5f service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received unexpected event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f for instance with vm_state building and task_state spawning.
Nov 29 21:48:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Waiting for libvirt event about the detach of device tap2e195153-63 with device alias net1 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 is timed out.
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 29 21:48:57 user nova-compute[75206]:   <name>instance-00000004</name>
Nov 29 21:48:57 user nova-compute[75206]:   <uuid>852f5aba-96eb-44f4-869a-aa635b6ec7e2</uuid>
Nov 29 21:48:57 user nova-compute[75206]:   <metadata>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:57 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:47:49</nova:creationTime>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:57 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:57 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:57 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:port uuid="2e195153-6399-4456-a867-0b5b187456a2">
Nov 29 21:48:57 user nova-compute[75206]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Nov 29 21:48:57 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:57 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:57 user nova-compute[75206]:   </metadata>
Nov 29 21:48:57 user nova-compute[75206]:   <memory unit='KiB'>524288</memory>
Nov 29 21:48:57 user nova-compute[75206]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 21:48:57 user nova-compute[75206]:   <vcpu placement='static'>1</vcpu>
Nov 29 21:48:57 user nova-compute[75206]:   <resource>
Nov 29 21:48:57 user nova-compute[75206]:     <partition>/machine</partition>
Nov 29 21:48:57 user nova-compute[75206]:   </resource>
Nov 29 21:48:57 user nova-compute[75206]:   <sysinfo type='smbios'>
Nov 29 21:48:57 user nova-compute[75206]:     <system>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='version'>0.0.0</entry>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='serial'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='uuid'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:57 user nova-compute[75206]:       <entry name='family'>Virtual Machine</entry>
Nov 29 21:48:57 user nova-compute[75206]:     </system>
Nov 29 21:48:57 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:57 user nova-compute[75206]:   <os>
Nov 29 21:48:57 user nova-compute[75206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 21:48:57 user nova-compute[75206]:     <boot dev='hd'/>
Nov 29 21:48:57 user nova-compute[75206]:     <smbios mode='sysinfo'/>
Nov 29 21:48:57 user nova-compute[75206]:   </os>
Nov 29 21:48:57 user nova-compute[75206]:   <features>
Nov 29 21:48:57 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:57 user nova-compute[75206]:     <apic/>
Nov 29 21:48:57 user nova-compute[75206]:     <vmcoreinfo state='on'/>
Nov 29 21:48:57 user nova-compute[75206]:   </features>
Nov 29 21:48:57 user nova-compute[75206]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 21:48:57 user nova-compute[75206]:     <model fallback='forbid'>Nehalem</model>
Nov 29 21:48:57 user nova-compute[75206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 21:48:57 user nova-compute[75206]:     <feature policy='require' name='vme'/>
Nov 29 21:48:57 user nova-compute[75206]:     <feature policy='require' name='x2apic'/>
Nov 29 21:48:57 user nova-compute[75206]:     <feature policy='require' name='hypervisor'/>
Nov 29 21:48:57 user nova-compute[75206]:   </cpu>
Nov 29 21:48:57 user nova-compute[75206]:   <clock offset='utc'>
Nov 29 21:48:57 user nova-compute[75206]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 21:48:57 user nova-compute[75206]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 21:48:57 user nova-compute[75206]:     <timer name='hpet' present='no'/>
Nov 29 21:48:57 user nova-compute[75206]:   </clock>
Nov 29 21:48:57 user nova-compute[75206]:   <on_poweroff>destroy</on_poweroff>
Nov 29 21:48:57 user nova-compute[75206]:   <on_reboot>restart</on_reboot>
Nov 29 21:48:57 user nova-compute[75206]:   <on_crash>destroy</on_crash>
Nov 29 21:48:57 user nova-compute[75206]:   <devices>
Nov 29 21:48:57 user nova-compute[75206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 21:48:57 user nova-compute[75206]:     <disk type='file' device='disk'>
Nov 29 21:48:57 user nova-compute[75206]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 21:48:57 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk' index='2'/>
Nov 29 21:48:57 user nova-compute[75206]:       <backingStore type='file' index='3'>
Nov 29 21:48:57 user nova-compute[75206]:         <format type='raw'/>
Nov 29 21:48:57 user nova-compute[75206]:         <source file='/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212'/>
Nov 29 21:48:57 user nova-compute[75206]:         <backingStore/>
Nov 29 21:48:57 user nova-compute[75206]:       </backingStore>
Nov 29 21:48:57 user nova-compute[75206]:       <target dev='vda' bus='virtio'/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='virtio-disk0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </disk>
Nov 29 21:48:57 user nova-compute[75206]:     <disk type='file' device='cdrom'>
Nov 29 21:48:57 user nova-compute[75206]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 21:48:57 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config' index='1'/>
Nov 29 21:48:57 user nova-compute[75206]:       <backingStore/>
Nov 29 21:48:57 user nova-compute[75206]:       <target dev='hda' bus='ide'/>
Nov 29 21:48:57 user nova-compute[75206]:       <readonly/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='ide0-0-0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </disk>
Nov 29 21:48:57 user nova-compute[75206]:     <controller type='usb' index='0' model='none'>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='usb'/>
Nov 29 21:48:57 user nova-compute[75206]:     </controller>
Nov 29 21:48:57 user nova-compute[75206]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='pci.0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </controller>
Nov 29 21:48:57 user nova-compute[75206]:     <controller type='ide' index='0'>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='ide'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 21:48:57 user nova-compute[75206]:     </controller>
Nov 29 21:48:57 user nova-compute[75206]:     <interface type='ethernet'>
Nov 29 21:48:57 user nova-compute[75206]:       <mac address='fa:16:3e:e5:8b:14'/>
Nov 29 21:48:57 user nova-compute[75206]:       <target dev='tapf5c0d0f5-e1'/>
Nov 29 21:48:57 user nova-compute[75206]:       <model type='virtio'/>
Nov 29 21:48:57 user nova-compute[75206]:       <mtu size='1442'/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='net0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </interface>
Nov 29 21:48:57 user nova-compute[75206]:     <serial type='pty'>
Nov 29 21:48:57 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:57 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:57 user nova-compute[75206]:       <target type='isa-serial' port='0'>
Nov 29 21:48:57 user nova-compute[75206]:         <model name='isa-serial'/>
Nov 29 21:48:57 user nova-compute[75206]:       </target>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </serial>
Nov 29 21:48:57 user nova-compute[75206]:     <console type='pty' tty='/dev/pts/4'>
Nov 29 21:48:57 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:57 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:57 user nova-compute[75206]:       <target type='serial' port='0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </console>
Nov 29 21:48:57 user nova-compute[75206]:     <input type='mouse' bus='ps2'>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='input0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </input>
Nov 29 21:48:57 user nova-compute[75206]:     <input type='keyboard' bus='ps2'>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='input1'/>
Nov 29 21:48:57 user nova-compute[75206]:     </input>
Nov 29 21:48:57 user nova-compute[75206]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 29 21:48:57 user nova-compute[75206]:       <listen type='address' address='0.0.0.0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </graphics>
Nov 29 21:48:57 user nova-compute[75206]:     <audio id='1' type='none'/>
Nov 29 21:48:57 user nova-compute[75206]:     <video>
Nov 29 21:48:57 user nova-compute[75206]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='video0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </video>
Nov 29 21:48:57 user nova-compute[75206]:     <memballoon model='virtio'>
Nov 29 21:48:57 user nova-compute[75206]:       <stats period='10'/>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='balloon0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:57 user nova-compute[75206]:     <rng model='virtio'>
Nov 29 21:48:57 user nova-compute[75206]:       <backend model='random'>/dev/urandom</backend>
Nov 29 21:48:57 user nova-compute[75206]:       <alias name='rng0'/>
Nov 29 21:48:57 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 21:48:57 user nova-compute[75206]:     </rng>
Nov 29 21:48:57 user nova-compute[75206]:   </devices>
Nov 29 21:48:57 user nova-compute[75206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 21:48:57 user nova-compute[75206]:     <label>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</label>
Nov 29 21:48:57 user nova-compute[75206]:     <imagelabel>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</imagelabel>
Nov 29 21:48:57 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:57 user nova-compute[75206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 21:48:57 user nova-compute[75206]:     <label>+64055:+108</label>
Nov 29 21:48:57 user nova-compute[75206]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 21:48:57 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:57 user nova-compute[75206]: </domain>
Nov 29 21:48:57 user nova-compute[75206]:  {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 21:48:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully detached device tap2e195153-63 from instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 from the live domain config.
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG os_vif [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e195153-63, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07360836-bd03-4cd7-9640-4bb6d73ef2e9) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:48:57 user nova-compute[75206]: INFO os_vif [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63')
Nov 29 21:48:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:57 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:48:57</nova:creationTime>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:57 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:57 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:57 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:57 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:57 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:57 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:57 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:57 user nova-compute[75206]:  {{(pid=75206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] No waiting events found dispatching network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:58 user nova-compute[75206]: WARNING nova.compute.manager [req-5b76bbf3-8ce7-43b5-804e-7d068d4f7f1c req-7ac2d38c-f2f9-4f7a-a073-187862901b32 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received unexpected event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 for instance with vm_state building and task_state spawning.
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-deleted-2e195153-6399-4456-a867-0b5b187456a2 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:58 user nova-compute[75206]: INFO nova.compute.manager [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Neutron deleted interface 2e195153-6399-4456-a867-0b5b187456a2; detaching it from the instance and deleting it from the info cache
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.objects.instance [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Lazy-loading 'system_metadata' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.objects.instance [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Lazy-loading 'flavor' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.objects.base [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Object Instance<852f5aba-96eb-44f4-869a-aa635b6ec7e2> lazy-loaded attributes: system_metadata,flavor {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 29 21:48:58 user nova-compute[75206]:   <name>instance-00000004</name>
Nov 29 21:48:58 user nova-compute[75206]:   <uuid>852f5aba-96eb-44f4-869a-aa635b6ec7e2</uuid>
Nov 29 21:48:58 user nova-compute[75206]:   <metadata>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:58 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:48:57</nova:creationTime>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:58 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:58 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:58 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:58 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:58 user nova-compute[75206]:   </metadata>
Nov 29 21:48:58 user nova-compute[75206]:   <memory unit='KiB'>524288</memory>
Nov 29 21:48:58 user nova-compute[75206]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 21:48:58 user nova-compute[75206]:   <vcpu placement='static'>1</vcpu>
Nov 29 21:48:58 user nova-compute[75206]:   <resource>
Nov 29 21:48:58 user nova-compute[75206]:     <partition>/machine</partition>
Nov 29 21:48:58 user nova-compute[75206]:   </resource>
Nov 29 21:48:58 user nova-compute[75206]:   <sysinfo type='smbios'>
Nov 29 21:48:58 user nova-compute[75206]:     <system>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='version'>0.0.0</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='serial'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='uuid'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='family'>Virtual Machine</entry>
Nov 29 21:48:58 user nova-compute[75206]:     </system>
Nov 29 21:48:58 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:58 user nova-compute[75206]:   <os>
Nov 29 21:48:58 user nova-compute[75206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 21:48:58 user nova-compute[75206]:     <boot dev='hd'/>
Nov 29 21:48:58 user nova-compute[75206]:     <smbios mode='sysinfo'/>
Nov 29 21:48:58 user nova-compute[75206]:   </os>
Nov 29 21:48:58 user nova-compute[75206]:   <features>
Nov 29 21:48:58 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:58 user nova-compute[75206]:     <apic/>
Nov 29 21:48:58 user nova-compute[75206]:     <vmcoreinfo state='on'/>
Nov 29 21:48:58 user nova-compute[75206]:   </features>
Nov 29 21:48:58 user nova-compute[75206]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 21:48:58 user nova-compute[75206]:     <model fallback='forbid'>Nehalem</model>
Nov 29 21:48:58 user nova-compute[75206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='vme'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='x2apic'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='hypervisor'/>
Nov 29 21:48:58 user nova-compute[75206]:   </cpu>
Nov 29 21:48:58 user nova-compute[75206]:   <clock offset='utc'>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='hpet' present='no'/>
Nov 29 21:48:58 user nova-compute[75206]:   </clock>
Nov 29 21:48:58 user nova-compute[75206]:   <on_poweroff>destroy</on_poweroff>
Nov 29 21:48:58 user nova-compute[75206]:   <on_reboot>restart</on_reboot>
Nov 29 21:48:58 user nova-compute[75206]:   <on_crash>destroy</on_crash>
Nov 29 21:48:58 user nova-compute[75206]:   <devices>
Nov 29 21:48:58 user nova-compute[75206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 21:48:58 user nova-compute[75206]:     <disk type='file' device='disk'>
Nov 29 21:48:58 user nova-compute[75206]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 21:48:58 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk' index='2'/>
Nov 29 21:48:58 user nova-compute[75206]:       <backingStore type='file' index='3'>
Nov 29 21:48:58 user nova-compute[75206]:         <format type='raw'/>
Nov 29 21:48:58 user nova-compute[75206]:         <source file='/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212'/>
Nov 29 21:48:58 user nova-compute[75206]:         <backingStore/>
Nov 29 21:48:58 user nova-compute[75206]:       </backingStore>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='vda' bus='virtio'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='virtio-disk0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </disk>
Nov 29 21:48:58 user nova-compute[75206]:     <disk type='file' device='cdrom'>
Nov 29 21:48:58 user nova-compute[75206]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 21:48:58 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config' index='1'/>
Nov 29 21:48:58 user nova-compute[75206]:       <backingStore/>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='hda' bus='ide'/>
Nov 29 21:48:58 user nova-compute[75206]:       <readonly/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='ide0-0-0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </disk>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='usb' index='0' model='none'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='usb'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='pci.0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='ide' index='0'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='ide'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <interface type='ethernet'>
Nov 29 21:48:58 user nova-compute[75206]:       <mac address='fa:16:3e:e5:8b:14'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='tapf5c0d0f5-e1'/>
Nov 29 21:48:58 user nova-compute[75206]:       <model type='virtio'/>
Nov 29 21:48:58 user nova-compute[75206]:       <mtu size='1442'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='net0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </interface>
Nov 29 21:48:58 user nova-compute[75206]:     <serial type='pty'>
Nov 29 21:48:58 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:58 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target type='isa-serial' port='0'>
Nov 29 21:48:58 user nova-compute[75206]:         <model name='isa-serial'/>
Nov 29 21:48:58 user nova-compute[75206]:       </target>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </serial>
Nov 29 21:48:58 user nova-compute[75206]:     <console type='pty' tty='/dev/pts/4'>
Nov 29 21:48:58 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:58 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target type='serial' port='0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </console>
Nov 29 21:48:58 user nova-compute[75206]:     <input type='mouse' bus='ps2'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='input0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </input>
Nov 29 21:48:58 user nova-compute[75206]:     <input type='keyboard' bus='ps2'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='input1'/>
Nov 29 21:48:58 user nova-compute[75206]:     </input>
Nov 29 21:48:58 user nova-compute[75206]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 29 21:48:58 user nova-compute[75206]:       <listen type='address' address='0.0.0.0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </graphics>
Nov 29 21:48:58 user nova-compute[75206]:     <audio id='1' type='none'/>
Nov 29 21:48:58 user nova-compute[75206]:     <video>
Nov 29 21:48:58 user nova-compute[75206]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='video0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </video>
Nov 29 21:48:58 user nova-compute[75206]:     <memballoon model='virtio'>
Nov 29 21:48:58 user nova-compute[75206]:       <stats period='10'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='balloon0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:58 user nova-compute[75206]:     <rng model='virtio'>
Nov 29 21:48:58 user nova-compute[75206]:       <backend model='random'>/dev/urandom</backend>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='rng0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </rng>
Nov 29 21:48:58 user nova-compute[75206]:   </devices>
Nov 29 21:48:58 user nova-compute[75206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 21:48:58 user nova-compute[75206]:     <label>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</label>
Nov 29 21:48:58 user nova-compute[75206]:     <imagelabel>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</imagelabel>
Nov 29 21:48:58 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:58 user nova-compute[75206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 21:48:58 user nova-compute[75206]:     <label>+64055:+108</label>
Nov 29 21:48:58 user nova-compute[75206]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 21:48:58 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:58 user nova-compute[75206]: </domain>
Nov 29 21:48:58 user nova-compute[75206]:  {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface> {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:6b:88"/><model type="virtio"/><mtu size="1442"/><target dev="tap2e195153-63"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 29 21:48:58 user nova-compute[75206]:   <name>instance-00000004</name>
Nov 29 21:48:58 user nova-compute[75206]:   <uuid>852f5aba-96eb-44f4-869a-aa635b6ec7e2</uuid>
Nov 29 21:48:58 user nova-compute[75206]:   <metadata>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:58 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:48:57</nova:creationTime>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:58 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:58 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:58 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:58 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:58 user nova-compute[75206]:   </metadata>
Nov 29 21:48:58 user nova-compute[75206]:   <memory unit='KiB'>524288</memory>
Nov 29 21:48:58 user nova-compute[75206]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 21:48:58 user nova-compute[75206]:   <vcpu placement='static'>1</vcpu>
Nov 29 21:48:58 user nova-compute[75206]:   <resource>
Nov 29 21:48:58 user nova-compute[75206]:     <partition>/machine</partition>
Nov 29 21:48:58 user nova-compute[75206]:   </resource>
Nov 29 21:48:58 user nova-compute[75206]:   <sysinfo type='smbios'>
Nov 29 21:48:58 user nova-compute[75206]:     <system>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='version'>0.0.0</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='serial'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='uuid'>852f5aba-96eb-44f4-869a-aa635b6ec7e2</entry>
Nov 29 21:48:58 user nova-compute[75206]:       <entry name='family'>Virtual Machine</entry>
Nov 29 21:48:58 user nova-compute[75206]:     </system>
Nov 29 21:48:58 user nova-compute[75206]:   </sysinfo>
Nov 29 21:48:58 user nova-compute[75206]:   <os>
Nov 29 21:48:58 user nova-compute[75206]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 21:48:58 user nova-compute[75206]:     <boot dev='hd'/>
Nov 29 21:48:58 user nova-compute[75206]:     <smbios mode='sysinfo'/>
Nov 29 21:48:58 user nova-compute[75206]:   </os>
Nov 29 21:48:58 user nova-compute[75206]:   <features>
Nov 29 21:48:58 user nova-compute[75206]:     <acpi/>
Nov 29 21:48:58 user nova-compute[75206]:     <apic/>
Nov 29 21:48:58 user nova-compute[75206]:     <vmcoreinfo state='on'/>
Nov 29 21:48:58 user nova-compute[75206]:   </features>
Nov 29 21:48:58 user nova-compute[75206]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 21:48:58 user nova-compute[75206]:     <model fallback='forbid'>Nehalem</model>
Nov 29 21:48:58 user nova-compute[75206]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='vme'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='x2apic'/>
Nov 29 21:48:58 user nova-compute[75206]:     <feature policy='require' name='hypervisor'/>
Nov 29 21:48:58 user nova-compute[75206]:   </cpu>
Nov 29 21:48:58 user nova-compute[75206]:   <clock offset='utc'>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 21:48:58 user nova-compute[75206]:     <timer name='hpet' present='no'/>
Nov 29 21:48:58 user nova-compute[75206]:   </clock>
Nov 29 21:48:58 user nova-compute[75206]:   <on_poweroff>destroy</on_poweroff>
Nov 29 21:48:58 user nova-compute[75206]:   <on_reboot>restart</on_reboot>
Nov 29 21:48:58 user nova-compute[75206]:   <on_crash>destroy</on_crash>
Nov 29 21:48:58 user nova-compute[75206]:   <devices>
Nov 29 21:48:58 user nova-compute[75206]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 21:48:58 user nova-compute[75206]:     <disk type='file' device='disk'>
Nov 29 21:48:58 user nova-compute[75206]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 21:48:58 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk' index='2'/>
Nov 29 21:48:58 user nova-compute[75206]:       <backingStore type='file' index='3'>
Nov 29 21:48:58 user nova-compute[75206]:         <format type='raw'/>
Nov 29 21:48:58 user nova-compute[75206]:         <source file='/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212'/>
Nov 29 21:48:58 user nova-compute[75206]:         <backingStore/>
Nov 29 21:48:58 user nova-compute[75206]:       </backingStore>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='vda' bus='virtio'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='virtio-disk0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </disk>
Nov 29 21:48:58 user nova-compute[75206]:     <disk type='file' device='cdrom'>
Nov 29 21:48:58 user nova-compute[75206]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 21:48:58 user nova-compute[75206]:       <source file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk.config' index='1'/>
Nov 29 21:48:58 user nova-compute[75206]:       <backingStore/>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='hda' bus='ide'/>
Nov 29 21:48:58 user nova-compute[75206]:       <readonly/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='ide0-0-0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </disk>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='usb' index='0' model='none'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='usb'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='pci.0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <controller type='ide' index='0'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='ide'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 21:48:58 user nova-compute[75206]:     </controller>
Nov 29 21:48:58 user nova-compute[75206]:     <interface type='ethernet'>
Nov 29 21:48:58 user nova-compute[75206]:       <mac address='fa:16:3e:e5:8b:14'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target dev='tapf5c0d0f5-e1'/>
Nov 29 21:48:58 user nova-compute[75206]:       <model type='virtio'/>
Nov 29 21:48:58 user nova-compute[75206]:       <mtu size='1442'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='net0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </interface>
Nov 29 21:48:58 user nova-compute[75206]:     <serial type='pty'>
Nov 29 21:48:58 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:58 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target type='isa-serial' port='0'>
Nov 29 21:48:58 user nova-compute[75206]:         <model name='isa-serial'/>
Nov 29 21:48:58 user nova-compute[75206]:       </target>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </serial>
Nov 29 21:48:58 user nova-compute[75206]:     <console type='pty' tty='/dev/pts/4'>
Nov 29 21:48:58 user nova-compute[75206]:       <source path='/dev/pts/4'/>
Nov 29 21:48:58 user nova-compute[75206]:       <log file='/opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/console.log' append='off'/>
Nov 29 21:48:58 user nova-compute[75206]:       <target type='serial' port='0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='serial0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </console>
Nov 29 21:48:58 user nova-compute[75206]:     <input type='mouse' bus='ps2'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='input0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </input>
Nov 29 21:48:58 user nova-compute[75206]:     <input type='keyboard' bus='ps2'>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='input1'/>
Nov 29 21:48:58 user nova-compute[75206]:     </input>
Nov 29 21:48:58 user nova-compute[75206]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 29 21:48:58 user nova-compute[75206]:       <listen type='address' address='0.0.0.0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </graphics>
Nov 29 21:48:58 user nova-compute[75206]:     <audio id='1' type='none'/>
Nov 29 21:48:58 user nova-compute[75206]:     <video>
Nov 29 21:48:58 user nova-compute[75206]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='video0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </video>
Nov 29 21:48:58 user nova-compute[75206]:     <memballoon model='virtio'>
Nov 29 21:48:58 user nova-compute[75206]:       <stats period='10'/>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='balloon0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </memballoon>
Nov 29 21:48:58 user nova-compute[75206]:     <rng model='virtio'>
Nov 29 21:48:58 user nova-compute[75206]:       <backend model='random'>/dev/urandom</backend>
Nov 29 21:48:58 user nova-compute[75206]:       <alias name='rng0'/>
Nov 29 21:48:58 user nova-compute[75206]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 21:48:58 user nova-compute[75206]:     </rng>
Nov 29 21:48:58 user nova-compute[75206]:   </devices>
Nov 29 21:48:58 user nova-compute[75206]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 21:48:58 user nova-compute[75206]:     <label>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</label>
Nov 29 21:48:58 user nova-compute[75206]:     <imagelabel>libvirt-852f5aba-96eb-44f4-869a-aa635b6ec7e2</imagelabel>
Nov 29 21:48:58 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:58 user nova-compute[75206]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 21:48:58 user nova-compute[75206]:     <label>+64055:+108</label>
Nov 29 21:48:58 user nova-compute[75206]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 21:48:58 user nova-compute[75206]:   </seclabel>
Nov 29 21:48:58 user nova-compute[75206]: </domain>
Nov 29 21:48:58 user nova-compute[75206]:  {{(pid=75206) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 21:48:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Detaching interface fa:16:3e:71:6b:88 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2e195153-63' not found.
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Converting VIF {"id": "2e195153-6399-4456-a867-0b5b187456a2", "address": "fa:16:3e:71:6b:88", "network": {"id": "8070db40-aedc-433f-9f52-928eb2fd56ab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-333254362", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e195153-63", "ovs_interfaceid": "2e195153-6399-4456-a867-0b5b187456a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG os_vif [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e195153-63, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:48:58 user nova-compute[75206]: INFO os_vif [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=2e195153-6399-4456-a867-0b5b187456a2,network=Network(8070db40-aedc-433f-9f52-928eb2fd56ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e195153-63')
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [req-df53df60-3c46-42e1-9742-96155b8fcd5a req-aafc1cc9-ee15-40b2-a266-650cd10dd091 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:48:58 user nova-compute[75206]:   <nova:package version="0.0.0"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:name>tempest-device-tagging-server-894663814</nova:name>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:creationTime>2023-11-29 21:48:58</nova:creationTime>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:flavor name="m1.tiny">
Nov 29 21:48:58 user nova-compute[75206]:     <nova:memory>512</nova:memory>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:disk>1</nova:disk>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:swap>0</nova:swap>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:vcpus>1</nova:vcpus>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:flavor>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:user uuid="35c9d4e110194df38abc8f14b889bfd3">tempest-TaggedAttachmentsTest-1737955283-project-member</nova:user>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:project uuid="3a62bab4355a485ba3863a0ad0314f6b">tempest-TaggedAttachmentsTest-1737955283</nova:project>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:owner>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:48:58 user nova-compute[75206]:   <nova:ports>
Nov 29 21:48:58 user nova-compute[75206]:     <nova:port uuid="f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1">
Nov 29 21:48:58 user nova-compute[75206]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:48:58 user nova-compute[75206]:     </nova:port>
Nov 29 21:48:58 user nova-compute[75206]:   </nova:ports>
Nov 29 21:48:58 user nova-compute[75206]: </nova:instance>
Nov 29 21:48:58 user nova-compute[75206]:  {{(pid=75206) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:48:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7095ee7c-4dab-4d74-aefa-469bacaeaf79 tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "interface-852f5aba-96eb-44f4-869a-aa635b6ec7e2-2e195153-6399-4456-a867-0b5b187456a2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.875s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:48:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:48:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:48:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:48:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] No waiting events found dispatching network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:48:59 user nova-compute[75206]: WARNING nova.compute.manager [req-d71feaf1-fa58-4db2-868c-5129b9e14eea req-24495990-82dd-47d7-8679-5ea0a654c2dd service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received unexpected event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f for instance with vm_state building and task_state spawning.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] No waiting events found dispatching network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:00 user nova-compute[75206]: WARNING nova.compute.manager [req-bc2e27f6-6962-4dc9-94cb-c594cfb4bf09 req-9a352a68-ec02-4326-9235-fa804ff42cf0 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received unexpected event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 for instance with vm_state building and task_state spawning.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Instance spawned successfully.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance spawned successfully.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Took 8.53 seconds to spawn the instance on the hypervisor.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.compute.manager [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Took 9.04 seconds to build instance.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bd1176f3-101c-4fd9-b0f9-ab8743f222f9 tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.162s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:00 user nova-compute[75206]: INFO nova.compute.manager [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Took 9.46 seconds to build instance.
Nov 29 21:49:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1eecf941-9840-49fd-aa07-853f44f6c657 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.559s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:49:09 user nova-compute[75206]: INFO nova.compute.claims [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Claim successful on node user
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:49:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.policy [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ccb0b04641b4f4f9015d71880f819f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a50384dbfc4c9692fc3af13949e535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:49:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Creating image(s)
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "/opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "/opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.202s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Successfully created port: 4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk 1073741824" returned: 0 in 0.045s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.166s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Cannot resize image /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Ensure instance console log exists: /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Successfully updated port: 4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquired lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-changed-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Refreshing instance network info cache due to event network-changed-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] Acquiring lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Updating instance_info_cache with network_info: [{"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Releasing lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Instance network_info: |[{"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] Acquired lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Refreshing network info cache for port 4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Start _get_guest_xml network_info=[{"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:49:11 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:11 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346575028',display_name='tempest-VolumesAdminNegativeTest-server-1346575028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346575028',id=16,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-c0stpfac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:49:10Z,user_data=None,user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=cf787f64-f716-44c1-b66f-53245b0d1181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.objects.instance [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'pci_devices' on Instance uuid cf787f64-f716-44c1-b66f-53245b0d1181 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:49:11 user nova-compute[75206]:   <uuid>cf787f64-f716-44c1-b66f-53245b0d1181</uuid>
Nov 29 21:49:11 user nova-compute[75206]:   <name>instance-00000010</name>
Nov 29 21:49:11 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:49:11 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:49:11 user nova-compute[75206]:   <metadata>
Nov 29 21:49:11 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:49:11 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1346575028</nova:name>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:49:11</nova:creationTime>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:49:11 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:49:11 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:owner>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:user uuid="7ccb0b04641b4f4f9015d71880f819f3">tempest-VolumesAdminNegativeTest-1427104861-project-member</nova:user>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:project uuid="c6a50384dbfc4c9692fc3af13949e535">tempest-VolumesAdminNegativeTest-1427104861</nova:project>
Nov 29 21:49:11 user nova-compute[75206]:       </nova:owner>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:49:11 user nova-compute[75206]:       <nova:ports>
Nov 29 21:49:11 user nova-compute[75206]:         <nova:port uuid="4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e">
Nov 29 21:49:11 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 21:49:11 user nova-compute[75206]:         </nova:port>
Nov 29 21:49:11 user nova-compute[75206]:       </nova:ports>
Nov 29 21:49:11 user nova-compute[75206]:     </nova:instance>
Nov 29 21:49:11 user nova-compute[75206]:   </metadata>
Nov 29 21:49:11 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:49:11 user nova-compute[75206]:     <system>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="serial">cf787f64-f716-44c1-b66f-53245b0d1181</entry>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="uuid">cf787f64-f716-44c1-b66f-53245b0d1181</entry>
Nov 29 21:49:11 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:49:11 user nova-compute[75206]:     </system>
Nov 29 21:49:11 user nova-compute[75206]:   </sysinfo>
Nov 29 21:49:11 user nova-compute[75206]:   <os>
Nov 29 21:49:11 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:49:11 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:49:11 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:49:11 user nova-compute[75206]:   </os>
Nov 29 21:49:11 user nova-compute[75206]:   <features>
Nov 29 21:49:11 user nova-compute[75206]:     <acpi/>
Nov 29 21:49:11 user nova-compute[75206]:     <apic/>
Nov 29 21:49:11 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:49:11 user nova-compute[75206]:   </features>
Nov 29 21:49:11 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:49:11 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:49:11 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:49:11 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:49:11 user nova-compute[75206]:   </clock>
Nov 29 21:49:11 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:49:11 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:49:11 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:49:11 user nova-compute[75206]:   </cpu>
Nov 29 21:49:11 user nova-compute[75206]:   <devices>
Nov 29 21:49:11 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:49:11 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:49:11 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk"/>
Nov 29 21:49:11 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:49:11 user nova-compute[75206]:     </disk>
Nov 29 21:49:11 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:49:11 user nova-compute[75206]:       <mac address="fa:16:3e:83:71:55"/>
Nov 29 21:49:11 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:49:11 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:49:11 user nova-compute[75206]:       <target dev="tap4fbcd67c-d3"/>
Nov 29 21:49:11 user nova-compute[75206]:     </interface>
Nov 29 21:49:11 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:49:11 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/console.log" append="off"/>
Nov 29 21:49:11 user nova-compute[75206]:     </serial>
Nov 29 21:49:11 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:49:11 user nova-compute[75206]:     <video>
Nov 29 21:49:11 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:49:11 user nova-compute[75206]:     </video>
Nov 29 21:49:11 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:49:11 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:49:11 user nova-compute[75206]:     </rng>
Nov 29 21:49:11 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:49:11 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:49:11 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:49:11 user nova-compute[75206]:     </memballoon>
Nov 29 21:49:11 user nova-compute[75206]:   </devices>
Nov 29 21:49:11 user nova-compute[75206]: </domain>
Nov 29 21:49:11 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346575028',display_name='tempest-VolumesAdminNegativeTest-server-1346575028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346575028',id=16,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-c0stpfac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:49:10Z,user_data=None,user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=cf787f64-f716-44c1-b66f-53245b0d1181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG os_vif [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '413778ea-1e19-5655-8f8b-b158e0320b7f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fbcd67c-d3, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fbcd67c-d3, col_values=(('qos', UUID('0a1d40a4-0073-4d83-8877-62fff36244c3')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fbcd67c-d3, col_values=(('external_ids', {'iface-id': '4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:71:55', 'vm-uuid': 'cf787f64-f716-44c1-b66f-53245b0d1181'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:11 user nova-compute[75206]: INFO os_vif [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3')
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] No VIF found with MAC fa:16:3e:83:71:55, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Updated VIF entry in instance network info cache for port 4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Updating instance_info_cache with network_info: [{"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd4f55d-a170-4301-b752-58fe2a7e42a6 req-b94de0b0-0ff2-4d1b-a645-034c242094db service nova] Releasing lock "refresh_cache-cf787f64-f716-44c1-b66f-53245b0d1181" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:12 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 is timed out.
Nov 29 21:49:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Successfully detached device vdb from instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 from the live domain config.
Nov 29 21:49:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JELjxyDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '2811f030-59f9-4d41-9319-6990514fc417'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:49:12 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f848421-aedd-4890-b881-94c4daee9c0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:49:12 user nova-compute[75206]: No targets found.
Nov 29 21:49:12 user nova-compute[75206]: iSNS:
Nov 29 21:49:12 user nova-compute[75206]: No targets found.
Nov 29 21:49:12 user nova-compute[75206]: STATIC:
Nov 29 21:49:12 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417
Nov 29 21:49:12 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:49:12 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:49:12 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:49:12 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:49:12 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:49:12 user nova-compute[75206]: FIRMWARE:
Nov 29 21:49:12 user nova-compute[75206]: No targets found.
Nov 29 21:49:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:49:12 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:49:12 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3672569-3b7c-4c29-bcc6-a9a1a4ddcc4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ebac7-cd72-4d43-ba8a-12826b554d55]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:49:12 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:49:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:49:12 user nova-compute[75206]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 (non-flash)
Nov 29 21:49:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b83ea320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[409cdd70-3040-49d0-b65b-7d1583e100f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[42426e3e-6bcf-42eb-9aea-117f4396e487]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6cdaf-f55c-4d7f-b985-4ff736b04abc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8439d7-8919-4f2b-9740-c65b409db491]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fa9d0-dc2b-4ce8-a758-65d7c62f29ba]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44593bb8-6aba-48d8-a4a5-414dad0dc27d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260]
Nov 29 21:49:12 user nova-compute[75206]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417, portal: 172.16.0.220,3260] successful.
Nov 29 21:49:12 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2811f030-59f9-4d41-9319-6990514fc417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a85697-7a4e-425f-90f0-e2bfafc31141]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] <== disconnect_volume: return (374ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] No waiting events found dispatching network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:12 user nova-compute[75206]: WARNING nova.compute.manager [req-a6c2472c-4a2f-491e-aa10-50ca715fb072 req-32f0f83f-c8af-4826-a0b8-d3633677c11e service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received unexpected event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e for instance with vm_state building and task_state spawning.
Nov 29 21:49:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:13 user nova-compute[75206]: DEBUG nova.objects.instance [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lazy-loading 'flavor' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1c596d2a-125f-4085-94f9-21f71cab3f8a tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.014s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] No waiting events found dispatching network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:14 user nova-compute[75206]: WARNING nova.compute.manager [req-a5aadbeb-a3f7-49d1-872e-96722dc888a8 req-8197d4b8-9616-454c-bd69-009b81620240 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received unexpected event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e for instance with vm_state building and task_state spawning.
Nov 29 21:49:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:49:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:49:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Instance spawned successfully.
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:49:15 user nova-compute[75206]: INFO nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 29 21:49:15 user nova-compute[75206]: DEBUG nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:49:15 user nova-compute[75206]: INFO nova.compute.manager [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Took 5.97 seconds to build instance.
Nov 29 21:49:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-78625499-3e7e-415a-9dcd-e4351114bd02 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.057s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:19 user nova-compute[75206]: WARNING nova.compute.manager [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Timeout waiting for ['volume-reimaged-28e66982-2444-45e3-bd55-0bd94990ca4a'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-28e66982-2444-45e3-bd55-0bd94990ca4a: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 29 21:49:19 user nova-compute[75206]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7f24c8193e20 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 29 21:49:19 user nova-compute[75206]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 29 21:49:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:20 user nova-compute[75206]: INFO nova.compute.manager [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Successfully reverted task state from rebuilding on failure for instance.
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server [None req-413f2745-4447-4bb3-b132-6f4374c4a4c2 tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 29 21:49:20 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.187s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:49:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:22 user nova-compute[75206]: INFO nova.compute.manager [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Terminating instance
Nov 29 21:49:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-unplugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] No waiting events found dispatching network-vif-unplugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-bcf99dec-8284-45ba-aabe-c3716e2e32d3 req-8d7c5f19-099d-4127-9dc3-35260783c4ce service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-unplugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Instance destroyed successfully.
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lazy-loading 'resources' on Instance uuid 94d891d6-a9e7-464e-b2d3-d829ba5cff8e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-116418356',display_name='tempest-VolumesAssistedSnapshotsTest-server-116418356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-116418356',id=8,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIprqftMJKt/hZ4UNylqrVH83JLPfSgjzz57qUO9kIbmWaJlO4xOL0UzBznIUSr74B0zw0ObaqnoigD4aOrUhB9bS/v3rHqt9dxqlzDHwotWRYAUKOuixZLtNjwshc+Ysw==',key_name='tempest-keypair-1675370620',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e26d008bca3f425595a0efccfc941dce',ramdisk_id='',reservation_id='r-khgwfri9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1437458539',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1437458539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da48168ea4546eaa9483e9a0f6b58ee',uuid=94d891d6-a9e7-464e-b2d3-d829ba5cff8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converting VIF {"id": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "address": "fa:16:3e:11:8d:bd", "network": {"id": "ecb945a3-8a04-4735-8773-e113efdd494f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649290314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e26d008bca3f425595a0efccfc941dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457b41c0-a6", "ovs_interfaceid": "457b41c0-a6b8-4e4b-95b3-ce0ace84edc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG os_vif [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457b41c0-a6, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0395ebc6-69fd-44a1-ac6f-279d1b84aa9a) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:23 user nova-compute[75206]: INFO os_vif [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:bd,bridge_name='br-int',has_traffic_filtering=True,id=457b41c0-a6b8-4e4b-95b3-ce0ace84edc5,network=Network(ecb945a3-8a04-4735-8773-e113efdd494f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457b41c0-a6')
Nov 29 21:49:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Deleting instance files /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e_del
Nov 29 21:49:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Deletion of /opt/stack/data/nova/instances/94d891d6-a9e7-464e-b2d3-d829ba5cff8e_del complete
Nov 29 21:49:23 user nova-compute[75206]: INFO nova.compute.manager [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:24 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Took 1.41 seconds to deallocate network for instance.
Nov 29 21:49:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7834MB free_disk=25.384597778320312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c09afa7c-2278-41c1-af97-6fbeb5609d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 7bc18f3e-d5cb-4653-91e7-766c0360c047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance cf787f64-f716-44c1-b66f-53245b0d1181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] Acquiring lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] No waiting events found dispatching network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:25 user nova-compute[75206]: WARNING nova.compute.manager [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received unexpected event network-vif-plugged-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 for instance with vm_state deleted and task_state None.
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-0520f551-061b-455c-8f7d-cbdef60f71e8 req-5284826f-87f4-4aa4-acfa-2a1bfe146887 service nova] [instance: 94d891d6-a9e7-464e-b2d3-d829ba5cff8e] Received event network-vif-deleted-457b41c0-a6b8-4e4b-95b3-ce0ace84edc5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.471s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:25 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Deleted allocations for instance 94d891d6-a9e7-464e-b2d3-d829ba5cff8e
Nov 29 21:49:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2e3237df-2088-4e03-88c0-50f343f304d3 tempest-VolumesAssistedSnapshotsTest-1437458539 tempest-VolumesAssistedSnapshotsTest-1437458539-project-member] Lock "94d891d6-a9e7-464e-b2d3-d829ba5cff8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.430s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:26 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [{"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-852f5aba-96eb-44f4-869a-aa635b6ec7e2" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:49:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:28 user nova-compute[75206]: INFO nova.compute.manager [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Terminating instance
Nov 29 21:49:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG nova.compute.manager [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-unplugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG nova.compute.manager [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-unplugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:28 user nova-compute[75206]: DEBUG nova.compute.manager [req-0358b164-572b-41bf-9e5a-a96d0611abc3 req-e3162c71-a283-4b28-8c34-8b6387100305 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-unplugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:49:29 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Instance destroyed successfully.
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lazy-loading 'resources' on Instance uuid 852f5aba-96eb-44f4-869a-aa635b6ec7e2 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-894663814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-894663814',id=4,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME49f1n9A+tq5R1sK5Tslyk7GgI3UQZ0po7Ej4D+j2nalHrp0J8LScxgXf9CmWLc5HQABFibJ/1UVmYZqw5mEQduyESihlmu8OjITc7Hcy6x3EoI9bpRQQD0t1ux1M9pg==',key_name='tempest-keypair-1239214939',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a62bab4355a485ba3863a0ad0314f6b',ramdisk_id='',reservation_id='r-3mwe09c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737955283',owner_user_name='tempest-TaggedAttachmentsTest-1737955283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c9d4e110194df38abc8f14b889bfd3',uuid=852f5aba-96eb-44f4-869a-aa635b6ec7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converting VIF {"id": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "address": "fa:16:3e:e5:8b:14", "network": {"id": "68375483-cd9e-4546-942c-fc971379a3c0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-630108445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a62bab4355a485ba3863a0ad0314f6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5c0d0f5-e1", "ovs_interfaceid": "f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG os_vif [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5c0d0f5-e1, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc69ea17-2e9c-4ad4-9fff-1bbc2f5206a4) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:29 user nova-compute[75206]: INFO os_vif [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1,network=Network(68375483-cd9e-4546-942c-fc971379a3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5c0d0f5-e1')
Nov 29 21:49:29 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Deleting instance files /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2_del
Nov 29 21:49:29 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Deletion of /opt/stack/data/nova/instances/852f5aba-96eb-44f4-869a-aa635b6ec7e2_del complete
Nov 29 21:49:29 user nova-compute[75206]: INFO nova.compute.manager [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 21:49:29 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:49:29 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:30 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Took 1.15 seconds to deallocate network for instance.
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-264fad59-ded9-43a2-9665-ec900c076fe5 req-48bd7bf7-90c6-4538-a6ff-c2b9bf9fc730 service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-deleted-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] Acquiring lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] No waiting events found dispatching network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:30 user nova-compute[75206]: WARNING nova.compute.manager [req-f60d5b49-d6f3-4a59-b59d-e4c7ad84d7dd req-8c7628ca-cc28-4172-9197-0c73007c15be service nova] [instance: 852f5aba-96eb-44f4-869a-aa635b6ec7e2] Received unexpected event network-vif-plugged-f5c0d0f5-e1c1-4cd4-bc75-7eb01d0514f1 for instance with vm_state deleted and task_state None.
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:30 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Deleted allocations for instance 852f5aba-96eb-44f4-869a-aa635b6ec7e2
Nov 29 21:49:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c6024b10-c59e-481a-a336-fbd99bc0f52b tempest-TaggedAttachmentsTest-1737955283 tempest-TaggedAttachmentsTest-1737955283-project-member] Lock "852f5aba-96eb-44f4-869a-aa635b6ec7e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:42 user nova-compute[75206]: INFO nova.compute.manager [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Terminating instance
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-unplugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] No waiting events found dispatching network-vif-unplugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-9f907e49-a662-4f44-993e-50fed5628e81 req-44e25ca2-d2fb-42e3-9ce2-53a088a523bd service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-unplugged-afd32a60-abd7-4862-9579-2ba297343b82 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Instance destroyed successfully.
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lazy-loading 'resources' on Instance uuid 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1987196421',display_name='tempest-TestVolumeSwap-server-1987196421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1987196421',id=3,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5W6B7d+2GMNs69Jjn/hB/Izd0ElgB9F4jrY5okYZB9zd0i98dHtKAfrWGUHthxCitXKb1inG3390FOU3ilz6SCEJ5uyspR1+Yxv2ZiceeyJ/dR8NtJhXR948zV3KaXg==',key_name='tempest-keypair-494131810',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4983deca1f0f40cf92f0d84ae5c9edc3',ramdisk_id='',reservation_id='r-6cj780mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1929009653',owner_user_name='tempest-TestVolumeSwap-1929009653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ffc43b6564041838634be86c274658d',uuid=6f335e0e-1ba6-428d-9aab-1f05d6ff18b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converting VIF {"id": "afd32a60-abd7-4862-9579-2ba297343b82", "address": "fa:16:3e:5c:99:67", "network": {"id": "969b7e78-2dad-4ec8-9a21-b7261286e8d1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1958926678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4983deca1f0f40cf92f0d84ae5c9edc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd32a60-ab", "ovs_interfaceid": "afd32a60-abd7-4862-9579-2ba297343b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG os_vif [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafd32a60-ab, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6978b692-a424-4492-b1c4-54536b65de0c) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:42 user nova-compute[75206]: INFO os_vif [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:99:67,bridge_name='br-int',has_traffic_filtering=True,id=afd32a60-abd7-4862-9579-2ba297343b82,network=Network(969b7e78-2dad-4ec8-9a21-b7261286e8d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd32a60-ab')
Nov 29 21:49:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Deleting instance files /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0_del
Nov 29 21:49:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Deletion of /opt/stack/data/nova/instances/6f335e0e-1ba6-428d-9aab-1f05d6ff18b0_del complete
Nov 29 21:49:43 user nova-compute[75206]: INFO nova.compute.manager [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 21:49:43 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:49:43 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:49:43 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:49:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:44 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Took 1.06 seconds to deallocate network for instance.
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-1b00d891-c633-4182-ab2a-99aa7cedad9b req-09eee673-d2a2-4fb7-949a-0b93403a7862 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-deleted-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:44 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Deleted allocations for instance 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] Acquiring lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] No waiting events found dispatching network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:44 user nova-compute[75206]: WARNING nova.compute.manager [req-ee980512-4853-4b42-8100-e03ddb98569c req-4f8755f2-4d3a-424c-bc42-8245070cf463 service nova] [instance: 6f335e0e-1ba6-428d-9aab-1f05d6ff18b0] Received unexpected event network-vif-plugged-afd32a60-abd7-4862-9579-2ba297343b82 for instance with vm_state deleted and task_state None.
Nov 29 21:49:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d9ce9431-dc32-4a5a-b84a-c43d35d8c34b tempest-TestVolumeSwap-1929009653 tempest-TestVolumeSwap-1929009653-project-member] Lock "6f335e0e-1ba6-428d-9aab-1f05d6ff18b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.570s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:49:54 user nova-compute[75206]: INFO nova.compute.claims [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Claim successful on node user
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:49:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.policy [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f1e0d3414724008be536b7ccf389d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a22aa096e084ddda505cd9dbf6dac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:49:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Creating image(s)
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "/opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "/opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "/opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-changed-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Refreshing instance network info cache due to event network-changed-f1547931-f5e1-4810-b319-708fcea975b3. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] Acquiring lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] Acquired lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Refreshing network info cache for port f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.215s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk 1073741824" returned: 0 in 0.062s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:56 user nova-compute[75206]: INFO nova.compute.manager [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Terminating instance
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.240s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Cannot resize image /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Ensure instance console log exists: /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Successfully created port: c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updated VIF entry in instance network info cache for port f1547931-f5e1-4810-b319-708fcea975b3. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updating instance_info_cache with network_info: [{"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ddbfe7fb-4296-45b9-878c-92083d56857f req-093826d7-9dbd-4d56-9148-18e9ae1519ac service nova] Releasing lock "refresh_cache-c09afa7c-2278-41c1-af97-6fbeb5609d8b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-unplugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] No waiting events found dispatching network-vif-unplugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-0ce697d8-4edf-4e92-ab35-804331a070ae req-a74d8ef4-74a7-42c9-bf42-169b02507bb9 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-unplugged-f1547931-f5e1-4810-b319-708fcea975b3 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:49:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Instance destroyed successfully.
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.objects.instance [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'resources' on Instance uuid c09afa7c-2278-41c1-af97-6fbeb5609d8b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1339869918',display_name='tempest-AttachVolumeNegativeTest-server-1339869918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1339869918',id=13,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmmeRf4rEh198GVptTKAAKfxllGGT8H+uT402adx7v+vCK4/D1jybZd+biEIT/mPBaCfJKGpRLvYnPA2FOHd7vB9ow2ulwctMDTnYwJQUO8/zs2irzN8umPwrpN2y4hMw==',key_name='tempest-keypair-1082337245',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:48:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-ekk8ijxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=c09afa7c-2278-41c1-af97-6fbeb5609d8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "f1547931-f5e1-4810-b319-708fcea975b3", "address": "fa:16:3e:94:8f:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1547931-f5", "ovs_interfaceid": "f1547931-f5e1-4810-b319-708fcea975b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG os_vif [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:49:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1547931-f5, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=add32fb8-0f10-4f72-8b1b-91bc0ac5e591) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:57 user nova-compute[75206]: INFO os_vif [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:8f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f1547931-f5e1-4810-b319-708fcea975b3,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1547931-f5')
Nov 29 21:49:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Deleting instance files /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b_del
Nov 29 21:49:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Deletion of /opt/stack/data/nova/instances/c09afa7c-2278-41c1-af97-6fbeb5609d8b_del complete
Nov 29 21:49:57 user nova-compute[75206]: INFO nova.compute.manager [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 21:49:57 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:49:57 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Successfully updated port: c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquired lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-changed-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Refreshing instance network info cache due to event network-changed-c11305df-ab89-4dbd-9a00-bd05e6bc85bc. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] Acquiring lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] Acquiring lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] No waiting events found dispatching network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:49:58 user nova-compute[75206]: WARNING nova.compute.manager [req-0bbf62cd-773d-415d-81aa-aa670ee7ba9f req-3489a5c1-beb5-4248-815c-a0f934eab5e8 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received unexpected event network-vif-plugged-f1547931-f5e1-4810-b319-708fcea975b3 for instance with vm_state active and task_state deleting.
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updating instance_info_cache with network_info: [{"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Releasing lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Instance network_info: |[{"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] Acquired lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Refreshing network info cache for port c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Start _get_guest_xml network_info=[{"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:49:59 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Took 2.13 seconds to deallocate network for instance.
Nov 29 21:49:59 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:59 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-747930159',display_name='tempest-ServersNegativeTestJSON-server-747930159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-747930159',id=17,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-vysplhc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:49:55Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=93c88682-7fb9-437f-9023-dc7dc9490205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lazy-loading 'pci_devices' on Instance uuid 93c88682-7fb9-437f-9023-dc7dc9490205 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:49:59 user nova-compute[75206]:   <uuid>93c88682-7fb9-437f-9023-dc7dc9490205</uuid>
Nov 29 21:49:59 user nova-compute[75206]:   <name>instance-00000011</name>
Nov 29 21:49:59 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:49:59 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:49:59 user nova-compute[75206]:   <metadata>
Nov 29 21:49:59 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:49:59 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:name>tempest-ServersNegativeTestJSON-server-747930159</nova:name>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:49:59</nova:creationTime>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:49:59 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:49:59 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:owner>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:user uuid="6f1e0d3414724008be536b7ccf389d41">tempest-ServersNegativeTestJSON-1799503281-project-member</nova:user>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:project uuid="3a22aa096e084ddda505cd9dbf6dac1c">tempest-ServersNegativeTestJSON-1799503281</nova:project>
Nov 29 21:49:59 user nova-compute[75206]:       </nova:owner>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:49:59 user nova-compute[75206]:       <nova:ports>
Nov 29 21:49:59 user nova-compute[75206]:         <nova:port uuid="c11305df-ab89-4dbd-9a00-bd05e6bc85bc">
Nov 29 21:49:59 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 21:49:59 user nova-compute[75206]:         </nova:port>
Nov 29 21:49:59 user nova-compute[75206]:       </nova:ports>
Nov 29 21:49:59 user nova-compute[75206]:     </nova:instance>
Nov 29 21:49:59 user nova-compute[75206]:   </metadata>
Nov 29 21:49:59 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:49:59 user nova-compute[75206]:     <system>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="serial">93c88682-7fb9-437f-9023-dc7dc9490205</entry>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="uuid">93c88682-7fb9-437f-9023-dc7dc9490205</entry>
Nov 29 21:49:59 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:49:59 user nova-compute[75206]:     </system>
Nov 29 21:49:59 user nova-compute[75206]:   </sysinfo>
Nov 29 21:49:59 user nova-compute[75206]:   <os>
Nov 29 21:49:59 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:49:59 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:49:59 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:49:59 user nova-compute[75206]:   </os>
Nov 29 21:49:59 user nova-compute[75206]:   <features>
Nov 29 21:49:59 user nova-compute[75206]:     <acpi/>
Nov 29 21:49:59 user nova-compute[75206]:     <apic/>
Nov 29 21:49:59 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:49:59 user nova-compute[75206]:   </features>
Nov 29 21:49:59 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:49:59 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:49:59 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:49:59 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:49:59 user nova-compute[75206]:   </clock>
Nov 29 21:49:59 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:49:59 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:49:59 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:49:59 user nova-compute[75206]:   </cpu>
Nov 29 21:49:59 user nova-compute[75206]:   <devices>
Nov 29 21:49:59 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:49:59 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:49:59 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk"/>
Nov 29 21:49:59 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:49:59 user nova-compute[75206]:     </disk>
Nov 29 21:49:59 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:49:59 user nova-compute[75206]:       <mac address="fa:16:3e:6e:ca:35"/>
Nov 29 21:49:59 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:49:59 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:49:59 user nova-compute[75206]:       <target dev="tapc11305df-ab"/>
Nov 29 21:49:59 user nova-compute[75206]:     </interface>
Nov 29 21:49:59 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:49:59 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/console.log" append="off"/>
Nov 29 21:49:59 user nova-compute[75206]:     </serial>
Nov 29 21:49:59 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:49:59 user nova-compute[75206]:     <video>
Nov 29 21:49:59 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:49:59 user nova-compute[75206]:     </video>
Nov 29 21:49:59 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:49:59 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:49:59 user nova-compute[75206]:     </rng>
Nov 29 21:49:59 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:49:59 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:49:59 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:49:59 user nova-compute[75206]:     </memballoon>
Nov 29 21:49:59 user nova-compute[75206]:   </devices>
Nov 29 21:49:59 user nova-compute[75206]: </domain>
Nov 29 21:49:59 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-747930159',display_name='tempest-ServersNegativeTestJSON-server-747930159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-747930159',id=17,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-vysplhc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:49:55Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=93c88682-7fb9-437f-9023-dc7dc9490205,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG os_vif [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad0631de-a34d-5234-ac38-e9f45d32af59', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc11305df-ab, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc11305df-ab, col_values=(('qos', UUID('b8822234-a3e7-42b4-9bed-466d602da443')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc11305df-ab, col_values=(('external_ids', {'iface-id': 'c11305df-ab89-4dbd-9a00-bd05e6bc85bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:ca:35', 'vm-uuid': '93c88682-7fb9-437f-9023-dc7dc9490205'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:49:59 user nova-compute[75206]: INFO os_vif [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab')
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] No VIF found with MAC fa:16:3e:6e:ca:35, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:49:59 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Deleted allocations for instance c09afa7c-2278-41c1-af97-6fbeb5609d8b
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updated VIF entry in instance network info cache for port c11305df-ab89-4dbd-9a00-bd05e6bc85bc. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updating instance_info_cache with network_info: [{"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-762ff12e-a983-407d-acfa-275931584c94 req-182037aa-9ad8-4faa-b6ec-53e92b874659 service nova] Releasing lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:49:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6428d93e-2ac8-42ef-8691-ba16ed52b081 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "c09afa7c-2278-41c1-af97-6fbeb5609d8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.848s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-90e33379-b6a3-4625-ab44-fb34c53fb04e req-a80e599c-966a-48e7-95d4-d3b67204dd97 service nova] [instance: c09afa7c-2278-41c1-af97-6fbeb5609d8b] Received event network-vif-deleted-f1547931-f5e1-4810-b319-708fcea975b3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] No waiting events found dispatching network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:01 user nova-compute[75206]: WARNING nova.compute.manager [req-97f67e53-335f-4eb3-a8cb-c65ef20451cc req-3c296b8b-f754-4130-9645-3ffe82b58274 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received unexpected event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc for instance with vm_state building and task_state spawning.
Nov 29 21:50:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:50:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Instance spawned successfully.
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] No waiting events found dispatching network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:03 user nova-compute[75206]: WARNING nova.compute.manager [req-3d725e37-61bc-4d21-9b09-360a728a3b1d req-cf7e084c-8f4c-4def-82e3-dfd1f0c0c9fd service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received unexpected event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc for instance with vm_state building and task_state spawning.
Nov 29 21:50:03 user nova-compute[75206]: INFO nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Took 8.37 seconds to spawn the instance on the hypervisor.
Nov 29 21:50:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:50:03 user nova-compute[75206]: INFO nova.compute.manager [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Took 9.20 seconds to build instance.
Nov 29 21:50:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bf79eb35-310d-46ac-9e16-d243adeed4cf tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.315s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:50:06 user nova-compute[75206]: INFO nova.compute.claims [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Claim successful on node user
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:50:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.policy [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79424ddb3af406d9ed8a1626a8f03ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffcb36d26c41cd99ccb16570f285dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:50:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Creating image(s)
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "/opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.224s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.264s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk 1073741824" returned: 0 in 0.132s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.403s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Successfully created port: 3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.225s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Cannot resize image /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Ensure instance console log exists: /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Successfully updated port: 3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-changed-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Refreshing instance network info cache due to event network-changed-3d701527-a109-4ae9-ab2a-9c02c1e05e83. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] Acquiring lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Instance network_info: |[{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] Acquired lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Refreshing network info cache for port 3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Start _get_guest_xml network_info=[{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:50:09 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:09 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775815736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775815736',id=18,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-1o0384ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:08Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=50c12935-165b-4de9-99c0-4e8ce348e6df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid 50c12935-165b-4de9-99c0-4e8ce348e6df {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:50:09 user nova-compute[75206]:   <uuid>50c12935-165b-4de9-99c0-4e8ce348e6df</uuid>
Nov 29 21:50:09 user nova-compute[75206]:   <name>instance-00000012</name>
Nov 29 21:50:09 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:50:09 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:50:09 user nova-compute[75206]:   <metadata>
Nov 29 21:50:09 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:50:09 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1775815736</nova:name>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:50:09</nova:creationTime>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:50:09 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:50:09 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:owner>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 21:50:09 user nova-compute[75206]:       </nova:owner>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:50:09 user nova-compute[75206]:       <nova:ports>
Nov 29 21:50:09 user nova-compute[75206]:         <nova:port uuid="3d701527-a109-4ae9-ab2a-9c02c1e05e83">
Nov 29 21:50:09 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 21:50:09 user nova-compute[75206]:         </nova:port>
Nov 29 21:50:09 user nova-compute[75206]:       </nova:ports>
Nov 29 21:50:09 user nova-compute[75206]:     </nova:instance>
Nov 29 21:50:09 user nova-compute[75206]:   </metadata>
Nov 29 21:50:09 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:50:09 user nova-compute[75206]:     <system>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="serial">50c12935-165b-4de9-99c0-4e8ce348e6df</entry>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="uuid">50c12935-165b-4de9-99c0-4e8ce348e6df</entry>
Nov 29 21:50:09 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:50:09 user nova-compute[75206]:     </system>
Nov 29 21:50:09 user nova-compute[75206]:   </sysinfo>
Nov 29 21:50:09 user nova-compute[75206]:   <os>
Nov 29 21:50:09 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:50:09 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:50:09 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:50:09 user nova-compute[75206]:   </os>
Nov 29 21:50:09 user nova-compute[75206]:   <features>
Nov 29 21:50:09 user nova-compute[75206]:     <acpi/>
Nov 29 21:50:09 user nova-compute[75206]:     <apic/>
Nov 29 21:50:09 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:50:09 user nova-compute[75206]:   </features>
Nov 29 21:50:09 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:50:09 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:50:09 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:50:09 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:50:09 user nova-compute[75206]:   </clock>
Nov 29 21:50:09 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:50:09 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:50:09 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:50:09 user nova-compute[75206]:   </cpu>
Nov 29 21:50:09 user nova-compute[75206]:   <devices>
Nov 29 21:50:09 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:50:09 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:50:09 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk"/>
Nov 29 21:50:09 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:50:09 user nova-compute[75206]:     </disk>
Nov 29 21:50:09 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:50:09 user nova-compute[75206]:       <mac address="fa:16:3e:a2:cb:f3"/>
Nov 29 21:50:09 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:09 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:50:09 user nova-compute[75206]:       <target dev="tap3d701527-a1"/>
Nov 29 21:50:09 user nova-compute[75206]:     </interface>
Nov 29 21:50:09 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:50:09 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/console.log" append="off"/>
Nov 29 21:50:09 user nova-compute[75206]:     </serial>
Nov 29 21:50:09 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:50:09 user nova-compute[75206]:     <video>
Nov 29 21:50:09 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:09 user nova-compute[75206]:     </video>
Nov 29 21:50:09 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:50:09 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:50:09 user nova-compute[75206]:     </rng>
Nov 29 21:50:09 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:50:09 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:50:09 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:50:09 user nova-compute[75206]:     </memballoon>
Nov 29 21:50:09 user nova-compute[75206]:   </devices>
Nov 29 21:50:09 user nova-compute[75206]: </domain>
Nov 29 21:50:09 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775815736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775815736',id=18,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-1o0384ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:08Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=50c12935-165b-4de9-99c0-4e8ce348e6df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG os_vif [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd2d226a-54ed-5068-a25a-c5a23574c30c', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d701527-a1, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d701527-a1, col_values=(('qos', UUID('ad13466c-bd0a-4956-a827-aa6b717aa7ef')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d701527-a1, col_values=(('external_ids', {'iface-id': '3d701527-a109-4ae9-ab2a-9c02c1e05e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:cb:f3', 'vm-uuid': '50c12935-165b-4de9-99c0-4e8ce348e6df'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:09 user nova-compute[75206]: INFO os_vif [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1')
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:50:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:a2:cb:f3, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:50:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updated VIF entry in instance network info cache for port 3d701527-a109-4ae9-ab2a-9c02c1e05e83. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:50:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7d1900f9-315e-4d63-965f-be0f18a64511 req-f1b8a75f-6a84-4c3a-86db-fcb6f0be15f9 service nova] Releasing lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] No waiting events found dispatching network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:11 user nova-compute[75206]: WARNING nova.compute.manager [req-d14bb7eb-2efe-44e8-97bb-dc9f390cb96b req-229df6a5-e223-4009-9ac1-6b8a312d3fc7 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received unexpected event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 for instance with vm_state building and task_state spawning.
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:50:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Instance spawned successfully.
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] No waiting events found dispatching network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:13 user nova-compute[75206]: WARNING nova.compute.manager [req-73f36e50-e2fb-4411-b802-6dccca0202ec req-23cd6f1f-082b-40a5-9777-1390f12767f4 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received unexpected event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 for instance with vm_state building and task_state spawning.
Nov 29 21:50:13 user nova-compute[75206]: INFO nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 29 21:50:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:50:13 user nova-compute[75206]: INFO nova.compute.manager [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Took 6.83 seconds to build instance.
Nov 29 21:50:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b4a46beb-f8b8-4224-b0dd-942b7c2c11c2 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:23 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:23 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=25.462081909179688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 7bc18f3e-d5cb-4653-91e7-766c0360c047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance cf787f64-f716-44c1-b66f-53245b0d1181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:50:23 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:50:24 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:24 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:50:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:50:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating instance_info_cache with network_info: [{"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:50:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:50:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:38 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:50:38 user nova-compute[75206]: INFO nova.compute.claims [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Claim successful on node user
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:50:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.policy [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93bf49b7d7334849ae0ed9632fa3c508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e3eac3db4a4ca09a436c696b50ada2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:50:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Creating image(s)
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:50:39 user nova-compute[75206]: INFO nova.compute.claims [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Claim successful on node user
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.213s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.249s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk 1073741824" returned: 0 in 0.068s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Successfully created port: 21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.250s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Cannot resize image /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Ensure instance console log exists: /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:50:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:50:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Creating image(s)
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG nova.policy [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93bf49b7d7334849ae0ed9632fa3c508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e3eac3db4a4ca09a436c696b50ada2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:50:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.257s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.228s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk 1073741824" returned: 0 in 0.051s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.217s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Cannot resize image /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Ensure instance console log exists: /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing instance network info cache due to event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing network info cache for port ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Successfully updated port: 21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:42 user nova-compute[75206]: INFO nova.compute.manager [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Terminating instance
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-changed-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Refreshing instance network info cache due to event network-changed-21862692-e750-499a-8a72-0ec3b9498c14. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Instance destroyed successfully.
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lazy-loading 'resources' on Instance uuid 7bc18f3e-d5cb-4653-91e7-766c0360c047 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1813080560',display_name='tempest-VolumesActionsTest-instance-1813080560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1813080560',id=15,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a2d0b7649174bcc950c52daf296b504',ramdisk_id='',reservation_id='r-9qr0bxxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514528984',owner_user_name='tempest-VolumesActionsTest-1514528984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:49:00Z,user_data=None,user_id='c0e5aeaa21d7401eb7aa308f258ba9b5',uuid=7bc18f3e-d5cb-4653-91e7-766c0360c047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converting VIF {"id": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "address": "fa:16:3e:43:9e:d2", "network": {"id": "c4c25e45-ab1e-4f93-814c-47d68bc2f2c4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-162271925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a2d0b7649174bcc950c52daf296b504", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c57-2c", "ovs_interfaceid": "5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG os_vif [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e6c3c57-2c, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cbd2721-0cbe-4e4d-94a4-68ce28d1bdee) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: INFO os_vif [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:d2,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1,network=Network(c4c25e45-ab1e-4f93-814c-47d68bc2f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c57-2c')
Nov 29 21:50:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Deleting instance files /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047_del
Nov 29 21:50:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Deletion of /opt/stack/data/nova/instances/7bc18f3e-d5cb-4653-91e7-766c0360c047_del complete
Nov 29 21:50:43 user nova-compute[75206]: INFO nova.compute.manager [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 29 21:50:43 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Successfully created port: 3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance network_info: |[{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Refreshing network info cache for port 21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start _get_guest_xml network_info=[{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:50:43 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:43 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1534183753',display_name='tempest-ServerRescueNegativeTestJSON-server-1534183753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1534183753',id=19,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-18urr8hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:39Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=6911f6f7-402e-4e43-9b0f-97cc3fd73f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:50:43 user nova-compute[75206]:   <uuid>6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</uuid>
Nov 29 21:50:43 user nova-compute[75206]:   <name>instance-00000013</name>
Nov 29 21:50:43 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:50:43 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:50:43 user nova-compute[75206]:   <metadata>
Nov 29 21:50:43 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:50:43 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1534183753</nova:name>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:50:43</nova:creationTime>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:50:43 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:50:43 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:owner>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 21:50:43 user nova-compute[75206]:       </nova:owner>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:50:43 user nova-compute[75206]:       <nova:ports>
Nov 29 21:50:43 user nova-compute[75206]:         <nova:port uuid="21862692-e750-499a-8a72-0ec3b9498c14">
Nov 29 21:50:43 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 21:50:43 user nova-compute[75206]:         </nova:port>
Nov 29 21:50:43 user nova-compute[75206]:       </nova:ports>
Nov 29 21:50:43 user nova-compute[75206]:     </nova:instance>
Nov 29 21:50:43 user nova-compute[75206]:   </metadata>
Nov 29 21:50:43 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:50:43 user nova-compute[75206]:     <system>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="serial">6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</entry>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="uuid">6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</entry>
Nov 29 21:50:43 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:50:43 user nova-compute[75206]:     </system>
Nov 29 21:50:43 user nova-compute[75206]:   </sysinfo>
Nov 29 21:50:43 user nova-compute[75206]:   <os>
Nov 29 21:50:43 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:50:43 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:50:43 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:50:43 user nova-compute[75206]:   </os>
Nov 29 21:50:43 user nova-compute[75206]:   <features>
Nov 29 21:50:43 user nova-compute[75206]:     <acpi/>
Nov 29 21:50:43 user nova-compute[75206]:     <apic/>
Nov 29 21:50:43 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:50:43 user nova-compute[75206]:   </features>
Nov 29 21:50:43 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:50:43 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:50:43 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:50:43 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:50:43 user nova-compute[75206]:   </clock>
Nov 29 21:50:43 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:50:43 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:50:43 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:50:43 user nova-compute[75206]:   </cpu>
Nov 29 21:50:43 user nova-compute[75206]:   <devices>
Nov 29 21:50:43 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:50:43 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:50:43 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk"/>
Nov 29 21:50:43 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:50:43 user nova-compute[75206]:     </disk>
Nov 29 21:50:43 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:50:43 user nova-compute[75206]:       <mac address="fa:16:3e:d7:5e:10"/>
Nov 29 21:50:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:43 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:50:43 user nova-compute[75206]:       <target dev="tap21862692-e7"/>
Nov 29 21:50:43 user nova-compute[75206]:     </interface>
Nov 29 21:50:43 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:50:43 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/console.log" append="off"/>
Nov 29 21:50:43 user nova-compute[75206]:     </serial>
Nov 29 21:50:43 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:50:43 user nova-compute[75206]:     <video>
Nov 29 21:50:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:43 user nova-compute[75206]:     </video>
Nov 29 21:50:43 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:50:43 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:50:43 user nova-compute[75206]:     </rng>
Nov 29 21:50:43 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:50:43 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:50:43 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:50:43 user nova-compute[75206]:     </memballoon>
Nov 29 21:50:43 user nova-compute[75206]:   </devices>
Nov 29 21:50:43 user nova-compute[75206]: </domain>
Nov 29 21:50:43 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1534183753',display_name='tempest-ServerRescueNegativeTestJSON-server-1534183753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1534183753',id=19,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-18urr8hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:39Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=6911f6f7-402e-4e43-9b0f-97cc3fd73f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG os_vif [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '003ca191-f3bf-54c4-9c94-957e3d819e95', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21862692-e7, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21862692-e7, col_values=(('qos', UUID('c0d993c7-1c93-48ef-9ac7-cfaa973ab405')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21862692-e7, col_values=(('external_ids', {'iface-id': '21862692-e750-499a-8a72-0ec3b9498c14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:5e:10', 'vm-uuid': '6911f6f7-402e-4e43-9b0f-97cc3fd73f9e'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:43 user nova-compute[75206]: INFO os_vif [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7')
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:50:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:d7:5e:10, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:44 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Took 0.78 seconds to deallocate network for instance.
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-vif-unplugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] No waiting events found dispatching network-vif-unplugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:44 user nova-compute[75206]: WARNING nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received unexpected event network-vif-unplugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 for instance with vm_state deleted and task_state None.
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Acquiring lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] No waiting events found dispatching network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:44 user nova-compute[75206]: WARNING nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received unexpected event network-vif-plugged-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 for instance with vm_state deleted and task_state None.
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a297f74-99ea-41ca-804a-138276b9e301 req-5e092156-f1c9-4adb-9df9-12db778d62e4 service nova] [instance: 7bc18f3e-d5cb-4653-91e7-766c0360c047] Received event network-vif-deleted-5e6c3c57-2c4f-409e-ba41-a9f9a8bd05e1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:44 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Deleted allocations for instance 7bc18f3e-d5cb-4653-91e7-766c0360c047
Nov 29 21:50:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8d8164c-23c0-4fd1-a1df-e7a0b842906d tempest-VolumesActionsTest-1514528984 tempest-VolumesActionsTest-1514528984-project-member] Lock "7bc18f3e-d5cb-4653-91e7-766c0360c047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.248s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updated VIF entry in instance network info cache for port ad856788-4434-42d5-b2c1-dfd545ff286f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-abb81a83-15b2-4e62-8ea6-4c6ab2ab7570 req-aab69bc8-8fcf-4b37-9a70-e159b50d0629 service nova] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updated VIF entry in instance network info cache for port 21862692-e750-499a-8a72-0ec3b9498c14. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe372b70-7007-41c3-a945-4724e176d428 req-87da223d-f781-4476-b090-8153b4f64faa service nova] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Successfully updated port: 3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-changed-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Refreshing instance network info cache due to event network-changed-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] Acquiring lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance network_info: |[{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] Acquired lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Refreshing network info cache for port 3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start _get_guest_xml network_info=[{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:50:46 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:46 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:50:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273751997',display_name='tempest-ServerRescueNegativeTestJSON-server-1273751997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273751997',id=20,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-o67tzilg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:41Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=4f8772b2-6486-4082-b9f1-962b13cda528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:50:47 user nova-compute[75206]:   <uuid>4f8772b2-6486-4082-b9f1-962b13cda528</uuid>
Nov 29 21:50:47 user nova-compute[75206]:   <name>instance-00000014</name>
Nov 29 21:50:47 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:50:47 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:50:47 user nova-compute[75206]:   <metadata>
Nov 29 21:50:47 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:50:47 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1273751997</nova:name>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:50:46</nova:creationTime>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:50:47 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:50:47 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:owner>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 21:50:47 user nova-compute[75206]:       </nova:owner>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:50:47 user nova-compute[75206]:       <nova:ports>
Nov 29 21:50:47 user nova-compute[75206]:         <nova:port uuid="3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0">
Nov 29 21:50:47 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 21:50:47 user nova-compute[75206]:         </nova:port>
Nov 29 21:50:47 user nova-compute[75206]:       </nova:ports>
Nov 29 21:50:47 user nova-compute[75206]:     </nova:instance>
Nov 29 21:50:47 user nova-compute[75206]:   </metadata>
Nov 29 21:50:47 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:50:47 user nova-compute[75206]:     <system>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="serial">4f8772b2-6486-4082-b9f1-962b13cda528</entry>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="uuid">4f8772b2-6486-4082-b9f1-962b13cda528</entry>
Nov 29 21:50:47 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:50:47 user nova-compute[75206]:     </system>
Nov 29 21:50:47 user nova-compute[75206]:   </sysinfo>
Nov 29 21:50:47 user nova-compute[75206]:   <os>
Nov 29 21:50:47 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:50:47 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:50:47 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:50:47 user nova-compute[75206]:   </os>
Nov 29 21:50:47 user nova-compute[75206]:   <features>
Nov 29 21:50:47 user nova-compute[75206]:     <acpi/>
Nov 29 21:50:47 user nova-compute[75206]:     <apic/>
Nov 29 21:50:47 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:50:47 user nova-compute[75206]:   </features>
Nov 29 21:50:47 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:50:47 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:50:47 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:50:47 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:50:47 user nova-compute[75206]:   </clock>
Nov 29 21:50:47 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:50:47 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:50:47 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:50:47 user nova-compute[75206]:   </cpu>
Nov 29 21:50:47 user nova-compute[75206]:   <devices>
Nov 29 21:50:47 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:50:47 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:50:47 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk"/>
Nov 29 21:50:47 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:50:47 user nova-compute[75206]:     </disk>
Nov 29 21:50:47 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:50:47 user nova-compute[75206]:       <mac address="fa:16:3e:ce:a1:51"/>
Nov 29 21:50:47 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:47 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:50:47 user nova-compute[75206]:       <target dev="tap3afa92ba-d3"/>
Nov 29 21:50:47 user nova-compute[75206]:     </interface>
Nov 29 21:50:47 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:50:47 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/console.log" append="off"/>
Nov 29 21:50:47 user nova-compute[75206]:     </serial>
Nov 29 21:50:47 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:50:47 user nova-compute[75206]:     <video>
Nov 29 21:50:47 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:47 user nova-compute[75206]:     </video>
Nov 29 21:50:47 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:50:47 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:50:47 user nova-compute[75206]:     </rng>
Nov 29 21:50:47 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:50:47 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:50:47 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:50:47 user nova-compute[75206]:     </memballoon>
Nov 29 21:50:47 user nova-compute[75206]:   </devices>
Nov 29 21:50:47 user nova-compute[75206]: </domain>
Nov 29 21:50:47 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273751997',display_name='tempest-ServerRescueNegativeTestJSON-server-1273751997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273751997',id=20,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-o67tzilg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:41Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=4f8772b2-6486-4082-b9f1-962b13cda528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG os_vif [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f05cf8e-beb2-5dbb-b563-252c5c68d437', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3afa92ba-d3, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3afa92ba-d3, col_values=(('qos', UUID('591dfacf-01f5-40c8-9ff4-d0a577f52f0c')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3afa92ba-d3, col_values=(('external_ids', {'iface-id': '3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:a1:51', 'vm-uuid': '4f8772b2-6486-4082-b9f1-962b13cda528'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:47 user nova-compute[75206]: INFO os_vif [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3')
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:ce:a1:51, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:50:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance spawned successfully.
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updated VIF entry in instance network info cache for port 3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d269c1b1-8fe0-412d-ab21-e736570f602a req-f6afe68a-cbb8-4fa5-b32e-bb0be6d917d5 service nova] Releasing lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:47 user nova-compute[75206]: INFO nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Took 8.37 seconds to spawn the instance on the hypervisor.
Nov 29 21:50:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:50:47 user nova-compute[75206]: INFO nova.compute.manager [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Took 9.44 seconds to build instance.
Nov 29 21:50:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80f1d012-6000-4cb8-b9ce-6d255965f42f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.606s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:48 user nova-compute[75206]: INFO nova.compute.manager [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Detaching volume c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:50:48 user nova-compute[75206]: INFO nova.virt.block_device [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Attempting to driver detach volume c1085ba0-3c79-472b-bca8-ca3bb94e2872 from mountpoint /dev/vdb
Nov 29 21:50:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Attempting to detach device vdb from instance f343e212-3a5d-43e2-8b8b-81135caffb2d from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:50:48 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:50:48 user nova-compute[75206]:   <source dev="/dev/sdi"/>
Nov 29 21:50:48 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:50:48 user nova-compute[75206]:   <serial>c1085ba0-3c79-472b-bca8-ca3bb94e2872</serial>
Nov 29 21:50:48 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:50:48 user nova-compute[75206]: </disk>
Nov 29 21:50:48 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:50:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance f343e212-3a5d-43e2-8b8b-81135caffb2d from the persistent domain config.
Nov 29 21:50:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f343e212-3a5d-43e2-8b8b-81135caffb2d from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:50:48 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:50:48 user nova-compute[75206]:   <source dev="/dev/sdi"/>
Nov 29 21:50:48 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:50:48 user nova-compute[75206]:   <serial>c1085ba0-3c79-472b-bca8-ca3bb94e2872</serial>
Nov 29 21:50:48 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:50:48 user nova-compute[75206]: </disk>
Nov 29 21:50:48 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:49 user nova-compute[75206]: WARNING nova.compute.manager [req-dc92681b-50b3-4320-8737-3a4ec4559b1a req-79c17a0c-cba8-4c30-82dd-162345c500e6 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state building and task_state spawning.
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:50:49 user nova-compute[75206]: INFO nova.compute.claims [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Claim successful on node user
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.874s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.policy [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e37b628d0f0a460aa528e4185c4b6683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f2c15727dc47e19d00ff536db432df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:50:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Creating image(s)
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:51 user nova-compute[75206]: WARNING nova.compute.manager [req-16566e62-e169-4c5c-bf34-0820add39fb4 req-4416dc44-7f75-4806-8432-62d4c72f9ec3 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state None.
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk 1073741824" returned: 0 in 0.060s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:51 user nova-compute[75206]: WARNING nova.compute.manager [req-e7981bc2-3f4e-4c6c-a47f-5135ad305e20 req-f455e635-9eb7-4a01-99b0-b738a0b768ad service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state building and task_state spawning.
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.233s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Successfully created port: ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Cannot resize image /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Ensure instance console log exists: /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:50:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance spawned successfully.
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:51 user nova-compute[75206]: INFO nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Took 11.15 seconds to spawn the instance on the hypervisor.
Nov 29 21:50:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:50:52 user nova-compute[75206]: INFO nova.compute.manager [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Took 12.38 seconds to build instance.
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3cc2ed3a-1c5b-4106-8e08-00ed4db83a6f tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.517s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Successfully updated port: ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance network_info: |[{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start _get_guest_xml network_info=[{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:50:52 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:52 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:50:52 user nova-compute[75206]:   <uuid>1d5f34b2-1301-4d46-9183-55c070ba28d5</uuid>
Nov 29 21:50:52 user nova-compute[75206]:   <name>instance-00000015</name>
Nov 29 21:50:52 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:50:52 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:50:52 user nova-compute[75206]:   <metadata>
Nov 29 21:50:52 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:50:52 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1888886025</nova:name>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:50:52</nova:creationTime>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:50:52 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:50:52 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:owner>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:user uuid="e37b628d0f0a460aa528e4185c4b6683">tempest-ServerActionsTestOtherB-957997184-project-member</nova:user>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:project uuid="44f2c15727dc47e19d00ff536db432df">tempest-ServerActionsTestOtherB-957997184</nova:project>
Nov 29 21:50:52 user nova-compute[75206]:       </nova:owner>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:50:52 user nova-compute[75206]:       <nova:ports>
Nov 29 21:50:52 user nova-compute[75206]:         <nova:port uuid="ebe76bc7-4889-4a62-8564-3a3cd230d96e">
Nov 29 21:50:52 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:50:52 user nova-compute[75206]:         </nova:port>
Nov 29 21:50:52 user nova-compute[75206]:       </nova:ports>
Nov 29 21:50:52 user nova-compute[75206]:     </nova:instance>
Nov 29 21:50:52 user nova-compute[75206]:   </metadata>
Nov 29 21:50:52 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:50:52 user nova-compute[75206]:     <system>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="serial">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="uuid">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:50:52 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:50:52 user nova-compute[75206]:     </system>
Nov 29 21:50:52 user nova-compute[75206]:   </sysinfo>
Nov 29 21:50:52 user nova-compute[75206]:   <os>
Nov 29 21:50:52 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:50:52 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:50:52 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:50:52 user nova-compute[75206]:   </os>
Nov 29 21:50:52 user nova-compute[75206]:   <features>
Nov 29 21:50:52 user nova-compute[75206]:     <acpi/>
Nov 29 21:50:52 user nova-compute[75206]:     <apic/>
Nov 29 21:50:52 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:50:52 user nova-compute[75206]:   </features>
Nov 29 21:50:52 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:50:52 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:50:52 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:50:52 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:50:52 user nova-compute[75206]:   </clock>
Nov 29 21:50:52 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:50:52 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:50:52 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:50:52 user nova-compute[75206]:   </cpu>
Nov 29 21:50:52 user nova-compute[75206]:   <devices>
Nov 29 21:50:52 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:50:52 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:50:52 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk"/>
Nov 29 21:50:52 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:50:52 user nova-compute[75206]:     </disk>
Nov 29 21:50:52 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:50:52 user nova-compute[75206]:       <mac address="fa:16:3e:2d:f2:ae"/>
Nov 29 21:50:52 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:52 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:50:52 user nova-compute[75206]:       <target dev="tapebe76bc7-48"/>
Nov 29 21:50:52 user nova-compute[75206]:     </interface>
Nov 29 21:50:52 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:50:52 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/console.log" append="off"/>
Nov 29 21:50:52 user nova-compute[75206]:     </serial>
Nov 29 21:50:52 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:50:52 user nova-compute[75206]:     <video>
Nov 29 21:50:52 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:50:52 user nova-compute[75206]:     </video>
Nov 29 21:50:52 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:50:52 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:50:52 user nova-compute[75206]:     </rng>
Nov 29 21:50:52 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:50:52 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:50:52 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:50:52 user nova-compute[75206]:     </memballoon>
Nov 29 21:50:52 user nova-compute[75206]:   </devices>
Nov 29 21:50:52 user nova-compute[75206]: </domain>
Nov 29 21:50:52 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG os_vif [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b45c3ed-b673-565d-b75a-4cfc9bf8212f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebe76bc7-48, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebe76bc7-48, col_values=(('qos', UUID('ff8b5838-117d-466a-a1c5-72f770ef825c')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebe76bc7-48, col_values=(('external_ids', {'iface-id': 'ebe76bc7-4889-4a62-8564-3a3cd230d96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:ae', 'vm-uuid': '1d5f34b2-1301-4d46-9183-55c070ba28d5'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:50:52 user nova-compute[75206]: INFO os_vif [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:50:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No VIF found with MAC fa:16:3e:2d:f2:ae, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:53 user nova-compute[75206]: WARNING nova.compute.manager [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state None.
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-changed-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Refreshing instance network info cache due to event network-changed-ebe76bc7-4889-4a62-8564-3a3cd230d96e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Refreshing network info cache for port ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updated VIF entry in instance network info cache for port ebe76bc7-4889-4a62-8564-3a3cd230d96e. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:50:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-01f90f76-4267-47b8-9cbe-6a9baf6d4c79 req-1cea0e50-5b5c-45ad-a95b-fd1899177ace service nova] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:54 user nova-compute[75206]: WARNING nova.compute.manager [req-87cf9466-c597-4f9f-98d5-6ef08a379b6e req-53ab2108-b45d-4ac7-953c-95902905add1 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state building and task_state spawning.
Nov 29 21:50:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:50:56 user nova-compute[75206]: WARNING nova.compute.manager [req-0d90589c-e5ac-404c-92b3-8b4350c1310d req-3f8a38b4-04c6-459a-8735-250fb790a674 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state building and task_state spawning.
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:50:57 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance spawned successfully.
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:50:57 user nova-compute[75206]: INFO nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 29 21:50:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:57 user nova-compute[75206]: INFO nova.compute.manager [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Took 8.30 seconds to build instance.
Nov 29 21:50:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4b0ff9a-2c76-40d7-b4d4-773f63e21659 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.524s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:50:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:50:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:51:07 user nova-compute[75206]: INFO nova.compute.claims [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Claim successful on node user
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:51:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:51:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.policy [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16f201d8cbf844e4b6726ce9f35ca439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c97bf8394f8462ab3804fff32aa78d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:51:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Creating image(s)
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk 1073741824" returned: 0 in 0.059s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Successfully created port: 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:51:09 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f343e212-3a5d-43e2-8b8b-81135caffb2d is timed out.
Nov 29 21:51:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance f343e212-3a5d-43e2-8b8b-81135caffb2d from the live domain config.
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhPlHfem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:51:09 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de904a1-63dd-410a-b425-c60a087744bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:51:09 user nova-compute[75206]: No targets found.
Nov 29 21:51:09 user nova-compute[75206]: iSNS:
Nov 29 21:51:09 user nova-compute[75206]: No targets found.
Nov 29 21:51:09 user nova-compute[75206]: STATIC:
Nov 29 21:51:09 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872
Nov 29 21:51:09 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:51:09 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:51:09 user nova-compute[75206]: FIRMWARE:
Nov 29 21:51:09 user nova-compute[75206]: No targets found.
Nov 29 21:51:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:51:09 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:51:09 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3935ae8c-3e38-41a4-8842-3fe8229daf96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f6b10-2414-4999-bfac-0dc99977099d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:51:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 (non-flash)
Nov 29 21:51:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b83ebc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872'): ({'sdi'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Removing single pathed devices sdi {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675286e-3a48-416a-823d-d9398ed382b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ac0ed-6c81-43f1-a8f6-74892ab24ed8]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flushing IO for device /dev/sdi {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[77058bd0-260e-4c41-975b-aa7fa23b787e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a0b006-47ee-4cf0-8cc3-9831f84befab]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] SCSI volumes sdi have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4bea2d-393f-48bc-8aa6-b0a7499efdcc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96110c85-f36c-4490-908e-e5f999b14644]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260]
Nov 29 21:51:09 user nova-compute[75206]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872, portal: 172.16.0.220,3260] successful.
Nov 29 21:51:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1085ba0-3c79-472b-bca8-ca3bb94e2872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d81169-4c90-402f-ab5c-63b494940554]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== disconnect_volume: return (346ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:51:09 user nova-compute[75206]: INFO nova.compute.claims [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Claim successful on node user
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Successfully updated port: 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing instance network info cache due to event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:51:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.policy [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e74a3cb54432457683dd38e8363528e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049af7fc294f49358608d0ab6a9b8d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance network_info: |[{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start _get_guest_xml network_info=[{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:51:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-244463796',display_name='tempest-ServerStableDeviceRescueTest-server-244463796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-244463796',id=22,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgDfI6cOSssiguvTUo1OxD2sn9+6FgjoVcX+pNO1J+Sce/OQuUX/V7hTKuQSrJwyg2tKN+JZWZzlLODLdoe4ORW8hXUbgBPBjXT6teOPO1JnIEn5IDb4NJqCqHLzpk+tg==',key_name='tempest-keypair-121556689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c97bf8394f8462ab3804fff32aa78d0',ramdisk_id='',reservation_id='r-rx7wd2jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1905805476',owner_user_name='tempest-ServerStableDeviceRescueTest-1905805476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f201d8cbf844e4b6726ce9f35ca439',uuid=a0f802b4-01a1-4f73-9045-2c775637d75d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converting VIF {"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.objects.instance [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:51:10 user nova-compute[75206]:   <uuid>a0f802b4-01a1-4f73-9045-2c775637d75d</uuid>
Nov 29 21:51:10 user nova-compute[75206]:   <name>instance-00000016</name>
Nov 29 21:51:10 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:51:10 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:51:10 user nova-compute[75206]:   <metadata>
Nov 29 21:51:10 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:51:10 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-244463796</nova:name>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:51:10</nova:creationTime>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:51:10 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:51:10 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:owner>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:user uuid="16f201d8cbf844e4b6726ce9f35ca439">tempest-ServerStableDeviceRescueTest-1905805476-project-member</nova:user>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:project uuid="8c97bf8394f8462ab3804fff32aa78d0">tempest-ServerStableDeviceRescueTest-1905805476</nova:project>
Nov 29 21:51:10 user nova-compute[75206]:       </nova:owner>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:51:10 user nova-compute[75206]:       <nova:ports>
Nov 29 21:51:10 user nova-compute[75206]:         <nova:port uuid="2d0df5d7-9c74-49f7-a2cd-dec9050dd926">
Nov 29 21:51:10 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 21:51:10 user nova-compute[75206]:         </nova:port>
Nov 29 21:51:10 user nova-compute[75206]:       </nova:ports>
Nov 29 21:51:10 user nova-compute[75206]:     </nova:instance>
Nov 29 21:51:10 user nova-compute[75206]:   </metadata>
Nov 29 21:51:10 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:51:10 user nova-compute[75206]:     <system>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="serial">a0f802b4-01a1-4f73-9045-2c775637d75d</entry>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="uuid">a0f802b4-01a1-4f73-9045-2c775637d75d</entry>
Nov 29 21:51:10 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:51:10 user nova-compute[75206]:     </system>
Nov 29 21:51:10 user nova-compute[75206]:   </sysinfo>
Nov 29 21:51:10 user nova-compute[75206]:   <os>
Nov 29 21:51:10 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:51:10 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:51:10 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:51:10 user nova-compute[75206]:   </os>
Nov 29 21:51:10 user nova-compute[75206]:   <features>
Nov 29 21:51:10 user nova-compute[75206]:     <acpi/>
Nov 29 21:51:10 user nova-compute[75206]:     <apic/>
Nov 29 21:51:10 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:51:10 user nova-compute[75206]:   </features>
Nov 29 21:51:10 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:51:10 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:51:10 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:51:10 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:51:10 user nova-compute[75206]:   </clock>
Nov 29 21:51:10 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:51:10 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:51:10 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:51:10 user nova-compute[75206]:   </cpu>
Nov 29 21:51:10 user nova-compute[75206]:   <devices>
Nov 29 21:51:10 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:51:10 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:51:10 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk"/>
Nov 29 21:51:10 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:51:10 user nova-compute[75206]:     </disk>
Nov 29 21:51:10 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:51:10 user nova-compute[75206]:       <mac address="fa:16:3e:91:f9:e4"/>
Nov 29 21:51:10 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:10 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:51:10 user nova-compute[75206]:       <target dev="tap2d0df5d7-9c"/>
Nov 29 21:51:10 user nova-compute[75206]:     </interface>
Nov 29 21:51:10 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:51:10 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/console.log" append="off"/>
Nov 29 21:51:10 user nova-compute[75206]:     </serial>
Nov 29 21:51:10 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:51:10 user nova-compute[75206]:     <video>
Nov 29 21:51:10 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:10 user nova-compute[75206]:     </video>
Nov 29 21:51:10 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:51:10 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:51:10 user nova-compute[75206]:     </rng>
Nov 29 21:51:10 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:51:10 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:51:10 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:51:10 user nova-compute[75206]:     </memballoon>
Nov 29 21:51:10 user nova-compute[75206]:   </devices>
Nov 29 21:51:10 user nova-compute[75206]: </domain>
Nov 29 21:51:10 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-244463796',display_name='tempest-ServerStableDeviceRescueTest-server-244463796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-244463796',id=22,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgDfI6cOSssiguvTUo1OxD2sn9+6FgjoVcX+pNO1J+Sce/OQuUX/V7hTKuQSrJwyg2tKN+JZWZzlLODLdoe4ORW8hXUbgBPBjXT6teOPO1JnIEn5IDb4NJqCqHLzpk+tg==',key_name='tempest-keypair-121556689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c97bf8394f8462ab3804fff32aa78d0',ramdisk_id='',reservation_id='r-rx7wd2jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1905805476',owner_user_name='tempest-ServerStableDeviceRescueTest-1905805476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f201d8cbf844e4b6726ce9f35ca439',uuid=a0f802b4-01a1-4f73-9045-2c775637d75d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converting VIF {"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG os_vif [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:51:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Creating image(s)
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "/opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "/opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53327b8-ad9a-5d9a-8818-c27e8980ceb3', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d0df5d7-9c, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d0df5d7-9c, col_values=(('qos', UUID('3d564cc1-00e6-417d-b6d1-39229d0eff47')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d0df5d7-9c, col_values=(('external_ids', {'iface-id': '2d0df5d7-9c74-49f7-a2cd-dec9050dd926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f9:e4', 'vm-uuid': 'a0f802b4-01a1-4f73-9045-2c775637d75d'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:10 user nova-compute[75206]: INFO os_vif [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c')
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No VIF found with MAC fa:16:3e:91:f9:e4, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.195s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk 1073741824" returned: 0 in 0.049s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updated VIF entry in instance network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fac5de78-3856-481e-bbd8-4649bd9bde9d req-b748a174-23e3-4004-a273-afbf8714d3f0 service nova] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Cannot resize image /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Ensure instance console log exists: /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Successfully created port: 927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:51:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Successfully updated port: 927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquired lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing instance network info cache due to event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] Acquiring lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating instance_info_cache with network_info: [{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Releasing lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Instance network_info: |[{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] Acquired lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.neutron [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Start _get_guest_xml network_info=[{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:51:12 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:12 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286299125',display_name='tempest-TestStampPattern-server-1286299125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286299125',id=23,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-goafpq2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:10Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=bd696537-2a16-49bf-b4aa-f3bb98ec609f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.objects.instance [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'pci_devices' on Instance uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:51:12 user nova-compute[75206]:   <uuid>bd696537-2a16-49bf-b4aa-f3bb98ec609f</uuid>
Nov 29 21:51:12 user nova-compute[75206]:   <name>instance-00000017</name>
Nov 29 21:51:12 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:51:12 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:51:12 user nova-compute[75206]:   <metadata>
Nov 29 21:51:12 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:51:12 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:name>tempest-TestStampPattern-server-1286299125</nova:name>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:51:12</nova:creationTime>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:51:12 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:51:12 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:owner>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:user uuid="e74a3cb54432457683dd38e8363528e7">tempest-TestStampPattern-1622973448-project-member</nova:user>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:project uuid="049af7fc294f49358608d0ab6a9b8d4f">tempest-TestStampPattern-1622973448</nova:project>
Nov 29 21:51:12 user nova-compute[75206]:       </nova:owner>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:51:12 user nova-compute[75206]:       <nova:ports>
Nov 29 21:51:12 user nova-compute[75206]:         <nova:port uuid="927c8a91-a743-43cf-ad22-5ff7b10f329d">
Nov 29 21:51:12 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 21:51:12 user nova-compute[75206]:         </nova:port>
Nov 29 21:51:12 user nova-compute[75206]:       </nova:ports>
Nov 29 21:51:12 user nova-compute[75206]:     </nova:instance>
Nov 29 21:51:12 user nova-compute[75206]:   </metadata>
Nov 29 21:51:12 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:51:12 user nova-compute[75206]:     <system>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="serial">bd696537-2a16-49bf-b4aa-f3bb98ec609f</entry>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="uuid">bd696537-2a16-49bf-b4aa-f3bb98ec609f</entry>
Nov 29 21:51:12 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:51:12 user nova-compute[75206]:     </system>
Nov 29 21:51:12 user nova-compute[75206]:   </sysinfo>
Nov 29 21:51:12 user nova-compute[75206]:   <os>
Nov 29 21:51:12 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:51:12 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:51:12 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:51:12 user nova-compute[75206]:   </os>
Nov 29 21:51:12 user nova-compute[75206]:   <features>
Nov 29 21:51:12 user nova-compute[75206]:     <acpi/>
Nov 29 21:51:12 user nova-compute[75206]:     <apic/>
Nov 29 21:51:12 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:51:12 user nova-compute[75206]:   </features>
Nov 29 21:51:12 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:51:12 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:51:12 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:51:12 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:51:12 user nova-compute[75206]:   </clock>
Nov 29 21:51:12 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:51:12 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:51:12 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:51:12 user nova-compute[75206]:   </cpu>
Nov 29 21:51:12 user nova-compute[75206]:   <devices>
Nov 29 21:51:12 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:51:12 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:51:12 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk"/>
Nov 29 21:51:12 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:51:12 user nova-compute[75206]:     </disk>
Nov 29 21:51:12 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:51:12 user nova-compute[75206]:       <mac address="fa:16:3e:9a:d9:7c"/>
Nov 29 21:51:12 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:12 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:51:12 user nova-compute[75206]:       <target dev="tap927c8a91-a7"/>
Nov 29 21:51:12 user nova-compute[75206]:     </interface>
Nov 29 21:51:12 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:51:12 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/console.log" append="off"/>
Nov 29 21:51:12 user nova-compute[75206]:     </serial>
Nov 29 21:51:12 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:51:12 user nova-compute[75206]:     <video>
Nov 29 21:51:12 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:12 user nova-compute[75206]:     </video>
Nov 29 21:51:12 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:51:12 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:51:12 user nova-compute[75206]:     </rng>
Nov 29 21:51:12 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:51:12 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:51:12 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:51:12 user nova-compute[75206]:     </memballoon>
Nov 29 21:51:12 user nova-compute[75206]:   </devices>
Nov 29 21:51:12 user nova-compute[75206]: </domain>
Nov 29 21:51:12 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286299125',display_name='tempest-TestStampPattern-server-1286299125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286299125',id=23,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-goafpq2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:10Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=bd696537-2a16-49bf-b4aa-f3bb98ec609f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG os_vif [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83fb8eeb-126d-572a-8328-f1d7ba118934', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap927c8a91-a7, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap927c8a91-a7, col_values=(('qos', UUID('fad85d6f-2a60-41d0-a54e-42af368de3e4')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap927c8a91-a7, col_values=(('external_ids', {'iface-id': '927c8a91-a743-43cf-ad22-5ff7b10f329d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d9:7c', 'vm-uuid': 'bd696537-2a16-49bf-b4aa-f3bb98ec609f'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:12 user nova-compute[75206]: INFO os_vif [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7')
Nov 29 21:51:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No VIF found with MAC fa:16:3e:9a:d9:7c, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updated VIF entry in instance network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating instance_info_cache with network_info: [{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-99241be1-2e9b-4611-b4db-2fa86d00fc35 req-1d5b175b-1dd4-49f1-a768-e3f81ee820a2 service nova] Releasing lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:13 user nova-compute[75206]: INFO nova.compute.manager [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Terminating instance
Nov 29 21:51:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-unplugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] No waiting events found dispatching network-vif-unplugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-d7d10925-97c3-4bda-a1db-1aedafb9413c req-55f30b18-2ae9-48e5-b539-b3cf306f28c2 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-unplugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:51:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance spawned successfully.
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:14 user nova-compute[75206]: INFO nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:14 user nova-compute[75206]: WARNING nova.compute.manager [req-769785c0-c8b4-4af3-bfd0-7122c8783310 req-8bb27462-b42f-4a83-b259-3d349d6673ce service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state building and task_state spawning.
Nov 29 21:51:14 user nova-compute[75206]: INFO nova.compute.manager [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Took 7.85 seconds to build instance.
Nov 29 21:51:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4ba44614-fc59-4cc1-a1a1-d0231527f560 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.968s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Instance destroyed successfully.
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.objects.instance [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'resources' on Instance uuid cf787f64-f716-44c1-b66f-53245b0d1181 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346575028',display_name='tempest-VolumesAdminNegativeTest-server-1346575028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346575028',id=16,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-c0stpfac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:49:15Z,user_data=None,user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=cf787f64-f716-44c1-b66f-53245b0d1181,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "address": "fa:16:3e:83:71:55", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fbcd67c-d3", "ovs_interfaceid": "4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG os_vif [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fbcd67c-d3, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a1d40a4-0073-4d83-8877-62fff36244c3) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: INFO os_vif [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:71:55,bridge_name='br-int',has_traffic_filtering=True,id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fbcd67c-d3')
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Deleting instance files /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181_del
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Deletion of /opt/stack/data/nova/instances/cf787f64-f716-44c1-b66f-53245b0d1181_del complete
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.compute.manager [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 29 21:51:15 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Took 0.55 seconds to deallocate network for instance.
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc1b4f2a-f947-426e-b82b-0e22360cf662 req-45ff1f14-baa8-401c-bb37-758e3bab2739 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-deleted-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:15 user nova-compute[75206]: INFO nova.compute.manager [req-cc1b4f2a-f947-426e-b82b-0e22360cf662 req-45ff1f14-baa8-401c-bb37-758e3bab2739 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Neutron deleted interface 4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e; detaching it from the instance and deleting it from the info cache
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.network.neutron [req-cc1b4f2a-f947-426e-b82b-0e22360cf662 req-45ff1f14-baa8-401c-bb37-758e3bab2739 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc1b4f2a-f947-426e-b82b-0e22360cf662 req-45ff1f14-baa8-401c-bb37-758e3bab2739 service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Detach interface failed, port_id=4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e, reason: Instance cf787f64-f716-44c1-b66f-53245b0d1181 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] Acquiring lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] Lock "cf787f64-f716-44c1-b66f-53245b0d1181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] No waiting events found dispatching network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:16 user nova-compute[75206]: WARNING nova.compute.manager [req-1310b706-e06f-4efe-ac46-b81e17501eb2 req-7325771a-b68c-45b6-80b7-32e8001bc29c service nova] [instance: cf787f64-f716-44c1-b66f-53245b0d1181] Received unexpected event network-vif-plugged-4fbcd67c-d3e9-4c0d-82b3-1b9013bb304e for instance with vm_state deleted and task_state None.
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Deleted allocations for instance cf787f64-f716-44c1-b66f-53245b0d1181
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-351fab85-5e33-4162-9af4-a505a9558049 tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "cf787f64-f716-44c1-b66f-53245b0d1181" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:16 user nova-compute[75206]: WARNING nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state active and task_state None.
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] No waiting events found dispatching network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:16 user nova-compute[75206]: WARNING nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received unexpected event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d for instance with vm_state building and task_state spawning.
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] No waiting events found dispatching network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:16 user nova-compute[75206]: WARNING nova.compute.manager [req-97f928e5-4e0e-4edc-89d7-e1f6220141e2 req-2ae8e1af-36d3-4cd3-9cd7-53ea213c4a39 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received unexpected event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d for instance with vm_state building and task_state spawning.
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:51:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Instance spawned successfully.
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:17 user nova-compute[75206]: INFO nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 29 21:51:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:51:17 user nova-compute[75206]: INFO nova.compute.manager [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Took 7.80 seconds to build instance.
Nov 29 21:51:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-515a4767-9e11-4bfa-87b0-535b1ad839b8 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.927s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:18 user nova-compute[75206]: DEBUG nova.objects.instance [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-68bb2d2c-3dd7-4028-885d-b27ba1af11e8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.036s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.36996078491211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f343e212-3a5d-43e2-8b8b-81135caffb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 21:51:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 21:51:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:27 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:51:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:38 user nova-compute[75206]: INFO nova.compute.manager [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Terminating instance
Nov 29 21:51:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-unplugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] No waiting events found dispatching network-vif-unplugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-0aa45c2e-2f80-4771-918f-731679e40419 req-09cfad3f-c65b-46de-99e3-5c1910b3500d service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-unplugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Instance destroyed successfully.
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'resources' on Instance uuid f343e212-3a5d-43e2-8b8b-81135caffb2d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1364712004',display_name='tempest-AttachVolumeNegativeTest-server-1364712004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1364712004',id=2,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd7PzjyYngXjpecWXu31NBenaaiyQKQqzRPM9Q8y4M85RJyF7qNyfYDDmQxoaLlddWiQDF2jIozrHHzj9KTU5mxnRZYPeyLHJVMHDnThzlDVJkk1Y5sADPY9O7RuSNuzQ==',key_name='tempest-keypair-1204995015',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:45:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-gfetg9pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f343e212-3a5d-43e2-8b8b-81135caffb2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "address": "fa:16:3e:ba:5c:28", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc085e7e9-fc", "ovs_interfaceid": "c085e7e9-fc00-4ca3-ae80-78307b0175d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG os_vif [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc085e7e9-fc, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=915d4c91-6d7e-4cd6-8510-3ba19abd4d83) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:39 user nova-compute[75206]: INFO os_vif [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:28,bridge_name='br-int',has_traffic_filtering=True,id=c085e7e9-fc00-4ca3-ae80-78307b0175d5,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc085e7e9-fc')
Nov 29 21:51:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Deleting instance files /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d_del
Nov 29 21:51:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Deletion of /opt/stack/data/nova/instances/f343e212-3a5d-43e2-8b8b-81135caffb2d_del complete
Nov 29 21:51:39 user nova-compute[75206]: INFO nova.compute.manager [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 21:51:39 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:51:39 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:40 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Took 0.91 seconds to deallocate network for instance.
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-675c3c4a-46be-40c0-ae28-624ad6a79a6e req-22cb2811-df26-4e9a-ac81-eefbaed172e5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-deleted-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:40 user nova-compute[75206]: INFO nova.compute.manager [req-675c3c4a-46be-40c0-ae28-624ad6a79a6e req-22cb2811-df26-4e9a-ac81-eefbaed172e5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Neutron deleted interface c085e7e9-fc00-4ca3-ae80-78307b0175d5; detaching it from the instance and deleting it from the info cache
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.network.neutron [req-675c3c4a-46be-40c0-ae28-624ad6a79a6e req-22cb2811-df26-4e9a-ac81-eefbaed172e5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-675c3c4a-46be-40c0-ae28-624ad6a79a6e req-22cb2811-df26-4e9a-ac81-eefbaed172e5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Detach interface failed, port_id=c085e7e9-fc00-4ca3-ae80-78307b0175d5, reason: Instance f343e212-3a5d-43e2-8b8b-81135caffb2d could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] Acquiring lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] No waiting events found dispatching network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:40 user nova-compute[75206]: WARNING nova.compute.manager [req-c9aa7b38-fcea-4cd9-9b71-60cd38297984 req-7bfd0abb-819d-4284-a605-921b8e55ead5 service nova] [instance: f343e212-3a5d-43e2-8b8b-81135caffb2d] Received unexpected event network-vif-plugged-c085e7e9-fc00-4ca3-ae80-78307b0175d5 for instance with vm_state deleted and task_state None.
Nov 29 21:51:40 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Deleted allocations for instance f343e212-3a5d-43e2-8b8b-81135caffb2d
Nov 29 21:51:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a24f07cb-8e8f-4151-b642-74a917f559f1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f343e212-3a5d-43e2-8b8b-81135caffb2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:46 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:51:46 user nova-compute[75206]: INFO nova.compute.claims [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Claim successful on node user
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:51:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.policy [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f1e0d3414724008be536b7ccf389d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a22aa096e084ddda505cd9dbf6dac1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:51:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Creating image(s)
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "/opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "/opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "/opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk 1073741824" returned: 0 in 0.055s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Successfully created port: aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Cannot resize image /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Ensure instance console log exists: /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Successfully updated port: aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquired lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-changed-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Refreshing instance network info cache due to event network-changed-aaff5fa5-f5be-4863-a3da-983a76c7d0c0. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:51:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] Acquiring lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Updating instance_info_cache with network_info: [{"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Releasing lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Instance network_info: |[{"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] Acquired lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Refreshing network info cache for port aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Start _get_guest_xml network_info=[{"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:51:49 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:49 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1539292106',display_name='tempest-ServersNegativeTestJSON-server-1539292106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1539292106',id=24,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-l2x8utfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:48Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=20aae253-226e-4930-8d9a-42993b9a6027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lazy-loading 'pci_devices' on Instance uuid 20aae253-226e-4930-8d9a-42993b9a6027 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:51:49 user nova-compute[75206]:   <uuid>20aae253-226e-4930-8d9a-42993b9a6027</uuid>
Nov 29 21:51:49 user nova-compute[75206]:   <name>instance-00000018</name>
Nov 29 21:51:49 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:51:49 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:51:49 user nova-compute[75206]:   <metadata>
Nov 29 21:51:49 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:51:49 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:name>tempest-ServersNegativeTestJSON-server-1539292106</nova:name>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:51:49</nova:creationTime>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:51:49 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:51:49 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:owner>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:user uuid="6f1e0d3414724008be536b7ccf389d41">tempest-ServersNegativeTestJSON-1799503281-project-member</nova:user>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:project uuid="3a22aa096e084ddda505cd9dbf6dac1c">tempest-ServersNegativeTestJSON-1799503281</nova:project>
Nov 29 21:51:49 user nova-compute[75206]:       </nova:owner>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:51:49 user nova-compute[75206]:       <nova:ports>
Nov 29 21:51:49 user nova-compute[75206]:         <nova:port uuid="aaff5fa5-f5be-4863-a3da-983a76c7d0c0">
Nov 29 21:51:49 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 21:51:49 user nova-compute[75206]:         </nova:port>
Nov 29 21:51:49 user nova-compute[75206]:       </nova:ports>
Nov 29 21:51:49 user nova-compute[75206]:     </nova:instance>
Nov 29 21:51:49 user nova-compute[75206]:   </metadata>
Nov 29 21:51:49 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:51:49 user nova-compute[75206]:     <system>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="serial">20aae253-226e-4930-8d9a-42993b9a6027</entry>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="uuid">20aae253-226e-4930-8d9a-42993b9a6027</entry>
Nov 29 21:51:49 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:51:49 user nova-compute[75206]:     </system>
Nov 29 21:51:49 user nova-compute[75206]:   </sysinfo>
Nov 29 21:51:49 user nova-compute[75206]:   <os>
Nov 29 21:51:49 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:51:49 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:51:49 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:51:49 user nova-compute[75206]:   </os>
Nov 29 21:51:49 user nova-compute[75206]:   <features>
Nov 29 21:51:49 user nova-compute[75206]:     <acpi/>
Nov 29 21:51:49 user nova-compute[75206]:     <apic/>
Nov 29 21:51:49 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:51:49 user nova-compute[75206]:   </features>
Nov 29 21:51:49 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:51:49 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:51:49 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:51:49 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:51:49 user nova-compute[75206]:   </clock>
Nov 29 21:51:49 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:51:49 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:51:49 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:51:49 user nova-compute[75206]:   </cpu>
Nov 29 21:51:49 user nova-compute[75206]:   <devices>
Nov 29 21:51:49 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:51:49 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:51:49 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk"/>
Nov 29 21:51:49 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:51:49 user nova-compute[75206]:     </disk>
Nov 29 21:51:49 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:51:49 user nova-compute[75206]:       <mac address="fa:16:3e:00:9e:96"/>
Nov 29 21:51:49 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:49 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:51:49 user nova-compute[75206]:       <target dev="tapaaff5fa5-f5"/>
Nov 29 21:51:49 user nova-compute[75206]:     </interface>
Nov 29 21:51:49 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:51:49 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/console.log" append="off"/>
Nov 29 21:51:49 user nova-compute[75206]:     </serial>
Nov 29 21:51:49 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:51:49 user nova-compute[75206]:     <video>
Nov 29 21:51:49 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:51:49 user nova-compute[75206]:     </video>
Nov 29 21:51:49 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:51:49 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:51:49 user nova-compute[75206]:     </rng>
Nov 29 21:51:49 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:51:49 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:51:49 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:51:49 user nova-compute[75206]:     </memballoon>
Nov 29 21:51:49 user nova-compute[75206]:   </devices>
Nov 29 21:51:49 user nova-compute[75206]: </domain>
Nov 29 21:51:49 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1539292106',display_name='tempest-ServersNegativeTestJSON-server-1539292106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1539292106',id=24,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-l2x8utfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:51:48Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=20aae253-226e-4930-8d9a-42993b9a6027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG os_vif [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eacd52c8-4a7a-507a-bdb6-c63421b9eb54', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaff5fa5-f5, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaff5fa5-f5, col_values=(('qos', UUID('7eb1a111-b770-4559-ae47-8b461717e8ad')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaff5fa5-f5, col_values=(('external_ids', {'iface-id': 'aaff5fa5-f5be-4863-a3da-983a76c7d0c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:9e:96', 'vm-uuid': '20aae253-226e-4930-8d9a-42993b9a6027'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:49 user nova-compute[75206]: INFO os_vif [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5')
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] No VIF found with MAC fa:16:3e:00:9e:96, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Updated VIF entry in instance network info cache for port aaff5fa5-f5be-4863-a3da-983a76c7d0c0. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Updating instance_info_cache with network_info: [{"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:51:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-37f87fe2-b7db-4ac7-b9fb-7c4c2e57053f req-84caaf95-55b2-4e09-9041-c012aaab0534 service nova] Releasing lock "refresh_cache-20aae253-226e-4930-8d9a-42993b9a6027" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:51:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] No waiting events found dispatching network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:51 user nova-compute[75206]: WARNING nova.compute.manager [req-f6c12d6e-4a0b-4338-a674-d9153d41bef6 req-52349921-5d63-4254-91cd-2270fc7d185b service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received unexpected event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 for instance with vm_state building and task_state spawning.
Nov 29 21:51:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:51:52 user nova-compute[75206]: WARNING nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 93c88682-7fb9-437f-9023-dc7dc9490205 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 50c12935-165b-4de9-99c0-4e8ce348e6df {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 20aae253-226e-4930-8d9a-42993b9a6027 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid d402a442-7a9d-4b60-9ce5-413fd24e23e8 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.269s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.267s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.266s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.270s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: INFO nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.272s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:52 user nova-compute[75206]: WARNING nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance is unexpectedly not found. Ignore.
Nov 29 21:51:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.436s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:51:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:51:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] No waiting events found dispatching network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:51:53 user nova-compute[75206]: WARNING nova.compute.manager [req-6e2c5140-4c91-435c-a558-52eec762eb48 req-ec543d50-4f66-437d-9251-05e26f80ce65 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received unexpected event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 for instance with vm_state building and task_state spawning.
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:51:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Instance spawned successfully.
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:51:54 user nova-compute[75206]: INFO nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 29 21:51:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:51:54 user nova-compute[75206]: INFO nova.compute.manager [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Took 7.75 seconds to build instance.
Nov 29 21:51:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b5d6262a-7d57-4754-9046-64bcd1c82e6f tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.852s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "20aae253-226e-4930-8d9a-42993b9a6027" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.417s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:51:54 user nova-compute[75206]: INFO nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 21:51:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "20aae253-226e-4930-8d9a-42993b9a6027" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:51:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:51:58 user nova-compute[75206]: INFO nova.compute.manager [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] instance snapshotting
Nov 29 21:51:58 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Beginning live snapshot process
Nov 29 21:51:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json -f qcow2" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2.delta 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:51:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2.delta 1073741824" returned: 0 in 0.050s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:51:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 21:52:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:52:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:52:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 21:52:01 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:52:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2.delta /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2.delta /opt/stack/data/nova/instances/snapshots/tmpt0ohxvfz/520f895e59f24bf68db0c8d5a35eeca2" returned: 0 in 0.352s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Snapshot extracted, beginning image upload
Nov 29 21:52:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Snapshot image upload complete
Nov 29 21:52:04 user nova-compute[75206]: INFO nova.compute.manager [None req-7dbbcf58-31ec-4b3e-a10a-c0a840cf7a09 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Took 5.54 seconds to snapshot the instance on the hypervisor.
Nov 29 21:52:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:08 user nova-compute[75206]: INFO nova.compute.manager [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Terminating instance
Nov 29 21:52:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-unplugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] No waiting events found dispatching network-vif-unplugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-d53a5d16-bfc2-4237-876c-418d2525b64f req-b488ee5b-7d82-4271-a5f7-3c651988e420 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-unplugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Instance destroyed successfully.
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lazy-loading 'resources' on Instance uuid ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:45:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1014089528',display_name='tempest-VolumesAdminNegativeTest-server-1014089528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1014089528',id=5,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW90M18P5spDDAKwHEoFOJmuECGIDTTfW81v/q32Y7PoqAnuWF9XW+mOIcioLDb5didG8blGYYb1BMYH4tpG5vIJ9qUfuKXvVoEHgikFhp5LqLE8ek8A0xrpwqP2mrgug==',key_name='tempest-keypair-49467320',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6a50384dbfc4c9692fc3af13949e535',ramdisk_id='',reservation_id='r-x88o2akw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1427104861',owner_user_name='tempest-VolumesAdminNegativeTest-1427104861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ccb0b04641b4f4f9015d71880f819f3',uuid=ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converting VIF {"id": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "address": "fa:16:3e:4d:22:7f", "network": {"id": "5b6c7fac-d58a-41a8-aab7-ac48d389c3d8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1422719954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6a50384dbfc4c9692fc3af13949e535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b2c974-f0", "ovs_interfaceid": "33b2c974-f064-470a-b5b1-ea9a4de1fff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG os_vif [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33b2c974-f0, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe1e0992-272a-4a13-b8df-6416610d6e1e) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:09 user nova-compute[75206]: INFO os_vif [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:22:7f,bridge_name='br-int',has_traffic_filtering=True,id=33b2c974-f064-470a-b5b1-ea9a4de1fff1,network=Network(5b6c7fac-d58a-41a8-aab7-ac48d389c3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b2c974-f0')
Nov 29 21:52:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Deleting instance files /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd_del
Nov 29 21:52:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Deletion of /opt/stack/data/nova/instances/ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd_del complete
Nov 29 21:52:09 user nova-compute[75206]: INFO nova.compute.manager [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 21:52:09 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:52:09 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:52:10 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:10 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Took 0.98 seconds to deallocate network for instance.
Nov 29 21:52:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:10 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:52:10 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:11 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Deleted allocations for instance ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd
Nov 29 21:52:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] Acquiring lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] No waiting events found dispatching network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:11 user nova-compute[75206]: WARNING nova.compute.manager [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received unexpected event network-vif-plugged-33b2c974-f064-470a-b5b1-ea9a4de1fff1 for instance with vm_state deleted and task_state None.
Nov 29 21:52:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-fa7eb851-0bfe-4de0-92aa-c53537502386 req-434a6942-044b-440d-b0d3-249edaa8b697 service nova] [instance: ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd] Received event network-vif-deleted-33b2c974-f064-470a-b5b1-ea9a4de1fff1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b92c7d2-7546-43aa-83e7-2fb4c7ce220f tempest-VolumesAdminNegativeTest-1427104861 tempest-VolumesAdminNegativeTest-1427104861-project-member] Lock "ea03f63a-36d6-43c4-b6b3-4196fd6ab4bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:24 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=25.280838012695312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 20aae253-226e-4930-8d9a-42993b9a6027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:52:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:52:28 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:29 user nova-compute[75206]: INFO nova.compute.manager [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Rescuing
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:52:29 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:30 user nova-compute[75206]: WARNING nova.compute.manager [req-6260efc5-c748-4729-9e3b-ff6a86212f8c req-0b48071b-2b83-43e3-a17e-933d139fbbe3 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state active and task_state rescuing.
Nov 29 21:52:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance destroyed successfully.
Nov 29 21:52:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Attempting rescue
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 21:52:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Creating image(s)
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue" returned: 0 in 0.047s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'migration_context' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.base [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<4f8772b2-6486-4082-b9f1-962b13cda528> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start _get_guest_xml network_info=[{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:ce:a1:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.base [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<4f8772b2-6486-4082-b9f1-962b13cda528> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.base [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<4f8772b2-6486-4082-b9f1-962b13cda528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:52:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.base [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<4f8772b2-6486-4082-b9f1-962b13cda528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273751997',display_name='tempest-ServerRescueNegativeTestJSON-server-1273751997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273751997',id=20,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-o67tzilg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:52Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=4f8772b2-6486-4082-b9f1-962b13cda528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:ce:a1:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:ce:a1:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.objects.base [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<4f8772b2-6486-4082-b9f1-962b13cda528> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:52:31 user nova-compute[75206]:   <uuid>4f8772b2-6486-4082-b9f1-962b13cda528</uuid>
Nov 29 21:52:31 user nova-compute[75206]:   <name>instance-00000014</name>
Nov 29 21:52:31 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:52:31 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:52:31 user nova-compute[75206]:   <metadata>
Nov 29 21:52:31 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:52:31 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1273751997</nova:name>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:52:31</nova:creationTime>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:52:31 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:52:31 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:owner>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 21:52:31 user nova-compute[75206]:       </nova:owner>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:52:31 user nova-compute[75206]:       <nova:ports>
Nov 29 21:52:31 user nova-compute[75206]:         <nova:port uuid="3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0">
Nov 29 21:52:31 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 21:52:31 user nova-compute[75206]:         </nova:port>
Nov 29 21:52:31 user nova-compute[75206]:       </nova:ports>
Nov 29 21:52:31 user nova-compute[75206]:     </nova:instance>
Nov 29 21:52:31 user nova-compute[75206]:   </metadata>
Nov 29 21:52:31 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:52:31 user nova-compute[75206]:     <system>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="serial">4f8772b2-6486-4082-b9f1-962b13cda528</entry>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="uuid">4f8772b2-6486-4082-b9f1-962b13cda528</entry>
Nov 29 21:52:31 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:52:31 user nova-compute[75206]:     </system>
Nov 29 21:52:31 user nova-compute[75206]:   </sysinfo>
Nov 29 21:52:31 user nova-compute[75206]:   <os>
Nov 29 21:52:31 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:52:31 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:52:31 user nova-compute[75206]:   </os>
Nov 29 21:52:31 user nova-compute[75206]:   <features>
Nov 29 21:52:31 user nova-compute[75206]:     <acpi/>
Nov 29 21:52:31 user nova-compute[75206]:     <apic/>
Nov 29 21:52:31 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:52:31 user nova-compute[75206]:   </features>
Nov 29 21:52:31 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:52:31 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:52:31 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:52:31 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:52:31 user nova-compute[75206]:   </clock>
Nov 29 21:52:31 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:52:31 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:52:31 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:52:31 user nova-compute[75206]:   </cpu>
Nov 29 21:52:31 user nova-compute[75206]:   <devices>
Nov 29 21:52:31 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:52:31 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:52:31 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue"/>
Nov 29 21:52:31 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:52:31 user nova-compute[75206]:     </disk>
Nov 29 21:52:31 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:52:31 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:52:31 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk"/>
Nov 29 21:52:31 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:52:31 user nova-compute[75206]:     </disk>
Nov 29 21:52:31 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:52:31 user nova-compute[75206]:       <mac address="fa:16:3e:ce:a1:51"/>
Nov 29 21:52:31 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:31 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:52:31 user nova-compute[75206]:       <target dev="tap3afa92ba-d3"/>
Nov 29 21:52:31 user nova-compute[75206]:     </interface>
Nov 29 21:52:31 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:52:31 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/console.log" append="off"/>
Nov 29 21:52:31 user nova-compute[75206]:     </serial>
Nov 29 21:52:31 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:52:31 user nova-compute[75206]:     <video>
Nov 29 21:52:31 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:31 user nova-compute[75206]:     </video>
Nov 29 21:52:31 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:52:31 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:52:31 user nova-compute[75206]:     </rng>
Nov 29 21:52:31 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:52:31 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:52:31 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:52:31 user nova-compute[75206]:     </memballoon>
Nov 29 21:52:31 user nova-compute[75206]:   </devices>
Nov 29 21:52:31 user nova-compute[75206]: </domain>
Nov 29 21:52:31 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:52:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance destroyed successfully.
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:ce:a1:51, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:52:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:52:32 user nova-compute[75206]: INFO nova.compute.claims [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Claim successful on node user
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:32 user nova-compute[75206]: WARNING nova.compute.manager [req-728903c2-fd1e-44b2-847b-358cb0e8df49 req-c65755c0-ff22-4e91-af3d-ce1971727bf8 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state active and task_state rescuing.
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:52:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:52:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.policy [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9befc13bc6ec4d6fb37d297c6927602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8009177c2d4cebaee3848aba1eeded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:52:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Creating image(s)
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "/opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk 1073741824" returned: 0 in 0.056s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Successfully created port: fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:52:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Cannot resize image /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Ensure instance console log exists: /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Successfully updated port: fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquired lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-changed-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Refreshing instance network info cache due to event network-changed-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] Acquiring lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:34 user nova-compute[75206]: WARNING nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state active and task_state rescuing.
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:34 user nova-compute[75206]: WARNING nova.compute.manager [req-173b500c-519a-41f5-bf69-c5cf0e42743d req-c13fa1b2-5ed0-4689-b074-e9d225341a8e service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state active and task_state rescuing.
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updating instance_info_cache with network_info: [{"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Releasing lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Instance network_info: |[{"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] Acquired lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Refreshing network info cache for port fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Start _get_guest_xml network_info=[{"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:52:34 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:34 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061763209',display_name='tempest-AttachVolumeNegativeTest-server-1061763209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061763209',id=25,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhPOXVIq/VzPF8M5EN2iGhEdl/v4IYL2x8DwtiHmcfvBcbqATGd5t+Bz+8b8vPcnMQkXEjExmM9XVQwo0Zal0wk+REMRl0jyyRFvhjNDad+JQnSZ8wQGh7oBVjRZj57xw==',key_name='tempest-keypair-696768959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-f4rnw7mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f603593a-9ed6-4750-be67-8004112c5093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'pci_devices' on Instance uuid f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:52:34 user nova-compute[75206]:   <uuid>f603593a-9ed6-4750-be67-8004112c5093</uuid>
Nov 29 21:52:34 user nova-compute[75206]:   <name>instance-00000019</name>
Nov 29 21:52:34 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:52:34 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:52:34 user nova-compute[75206]:   <metadata>
Nov 29 21:52:34 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:52:34 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1061763209</nova:name>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:52:34</nova:creationTime>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:52:34 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:52:34 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:owner>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:user uuid="9befc13bc6ec4d6fb37d297c6927602f">tempest-AttachVolumeNegativeTest-330553211-project-member</nova:user>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:project uuid="9e8009177c2d4cebaee3848aba1eeded">tempest-AttachVolumeNegativeTest-330553211</nova:project>
Nov 29 21:52:34 user nova-compute[75206]:       </nova:owner>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:52:34 user nova-compute[75206]:       <nova:ports>
Nov 29 21:52:34 user nova-compute[75206]:         <nova:port uuid="fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55">
Nov 29 21:52:34 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 21:52:34 user nova-compute[75206]:         </nova:port>
Nov 29 21:52:34 user nova-compute[75206]:       </nova:ports>
Nov 29 21:52:34 user nova-compute[75206]:     </nova:instance>
Nov 29 21:52:34 user nova-compute[75206]:   </metadata>
Nov 29 21:52:34 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:52:34 user nova-compute[75206]:     <system>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="serial">f603593a-9ed6-4750-be67-8004112c5093</entry>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="uuid">f603593a-9ed6-4750-be67-8004112c5093</entry>
Nov 29 21:52:34 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:52:34 user nova-compute[75206]:     </system>
Nov 29 21:52:34 user nova-compute[75206]:   </sysinfo>
Nov 29 21:52:34 user nova-compute[75206]:   <os>
Nov 29 21:52:34 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:52:34 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:52:34 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:52:34 user nova-compute[75206]:   </os>
Nov 29 21:52:34 user nova-compute[75206]:   <features>
Nov 29 21:52:34 user nova-compute[75206]:     <acpi/>
Nov 29 21:52:34 user nova-compute[75206]:     <apic/>
Nov 29 21:52:34 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:52:34 user nova-compute[75206]:   </features>
Nov 29 21:52:34 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:52:34 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:52:34 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:52:34 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:52:34 user nova-compute[75206]:   </clock>
Nov 29 21:52:34 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:52:34 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:52:34 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:52:34 user nova-compute[75206]:   </cpu>
Nov 29 21:52:34 user nova-compute[75206]:   <devices>
Nov 29 21:52:34 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:52:34 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:52:34 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk"/>
Nov 29 21:52:34 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:52:34 user nova-compute[75206]:     </disk>
Nov 29 21:52:34 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:52:34 user nova-compute[75206]:       <mac address="fa:16:3e:20:2e:73"/>
Nov 29 21:52:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:34 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:52:34 user nova-compute[75206]:       <target dev="tapfe0919b5-b0"/>
Nov 29 21:52:34 user nova-compute[75206]:     </interface>
Nov 29 21:52:34 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:52:34 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/console.log" append="off"/>
Nov 29 21:52:34 user nova-compute[75206]:     </serial>
Nov 29 21:52:34 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:52:34 user nova-compute[75206]:     <video>
Nov 29 21:52:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:34 user nova-compute[75206]:     </video>
Nov 29 21:52:34 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:52:34 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:52:34 user nova-compute[75206]:     </rng>
Nov 29 21:52:34 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:52:34 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:52:34 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:52:34 user nova-compute[75206]:     </memballoon>
Nov 29 21:52:34 user nova-compute[75206]:   </devices>
Nov 29 21:52:34 user nova-compute[75206]: </domain>
Nov 29 21:52:34 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061763209',display_name='tempest-AttachVolumeNegativeTest-server-1061763209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061763209',id=25,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhPOXVIq/VzPF8M5EN2iGhEdl/v4IYL2x8DwtiHmcfvBcbqATGd5t+Bz+8b8vPcnMQkXEjExmM9XVQwo0Zal0wk+REMRl0jyyRFvhjNDad+JQnSZ8wQGh7oBVjRZj57xw==',key_name='tempest-keypair-696768959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-f4rnw7mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f603593a-9ed6-4750-be67-8004112c5093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG os_vif [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2c42efa-1b6a-5079-8f63-8490bfec7f31', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0919b5-b0, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe0919b5-b0, col_values=(('qos', UUID('52fcccb2-4666-4735-a105-0f2d65d88da8')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe0919b5-b0, col_values=(('external_ids', {'iface-id': 'fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:2e:73', 'vm-uuid': 'f603593a-9ed6-4750-be67-8004112c5093'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:34 user nova-compute[75206]: INFO os_vif [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0')
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0eec33ac-cb25-4195-9ad7-0a24470d31e2 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:52:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:20:2e:73, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:52:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updated VIF entry in instance network info cache for port fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:52:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updating instance_info_cache with network_info: [{"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-797b7342-e5f9-4f58-aeac-2a9e30ba7f81 req-8fa59695-5e08-4aec-90dc-b18a44d6c9ea service nova] Releasing lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:36 user nova-compute[75206]: WARNING nova.compute.manager [req-58d8a3c3-07ad-487a-a647-170cd05cce20 req-768fc90c-f77e-4e22-a1df-ca475c39af22 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state building and task_state spawning.
Nov 29 21:52:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:52:38 user nova-compute[75206]: INFO nova.compute.claims [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Claim successful on node user
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:38 user nova-compute[75206]: WARNING nova.compute.manager [req-23a81bd8-adcc-403e-acfc-75ef9ca09a29 req-d67387b4-af1d-4765-a5c0-8e176ce8fef2 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state building and task_state spawning.
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:52:38 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:52:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.policy [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '656a5b2470e14813b3060d41b1d61095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa0640f6b84a71b856782e45ca4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:52:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] Instance spawned successfully.
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:52:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Creating image(s)
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:39 user nova-compute[75206]: INFO nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 29 21:52:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:39 user nova-compute[75206]: INFO nova.compute.manager [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Took 7.13 seconds to build instance.
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d5eb862a-5800-4194-ab63-b16af3785640 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.241s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk 1073741824" returned: 0 in 0.069s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Successfully created port: a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.219s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Cannot resize image /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Ensure instance console log exists: /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-changed-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Refreshing instance network info cache due to event network-changed-ebe76bc7-4889-4a62-8564-3a3cd230d96e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Refreshing network info cache for port ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Successfully updated port: a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-changed-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Refreshing instance network info cache due to event network-changed-a3b1902e-6a42-4849-8d5c-0567d9601b8f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] Acquiring lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updated VIF entry in instance network info cache for port ebe76bc7-4889-4a62-8564-3a3cd230d96e. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79ea4807-0e6d-44bc-93e5-073cfaf231a1 req-d359dedd-febe-4a65-a487-7e21901cc87e service nova] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating instance_info_cache with network_info: [{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance network_info: |[{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] Acquired lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Refreshing network info cache for port a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start _get_guest_xml network_info=[{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:52:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-tempest.common.compute-instance-410845633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'pci_devices' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:52:42 user nova-compute[75206]:   <uuid>39f1132e-912d-455d-8686-6bdaf870da24</uuid>
Nov 29 21:52:42 user nova-compute[75206]:   <name>instance-0000001a</name>
Nov 29 21:52:42 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:52:42 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:52:42 user nova-compute[75206]:   <metadata>
Nov 29 21:52:42 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:52:42 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:name>tempest-tempest.common.compute-instance-410845633</nova:name>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:52:42</nova:creationTime>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:52:42 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:52:42 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:owner>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:user uuid="656a5b2470e14813b3060d41b1d61095">tempest-ServerActionsTestOtherA-2043072317-project-member</nova:user>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:project uuid="feaa0640f6b84a71b856782e45ca4adf">tempest-ServerActionsTestOtherA-2043072317</nova:project>
Nov 29 21:52:42 user nova-compute[75206]:       </nova:owner>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:52:42 user nova-compute[75206]:       <nova:ports>
Nov 29 21:52:42 user nova-compute[75206]:         <nova:port uuid="a3b1902e-6a42-4849-8d5c-0567d9601b8f">
Nov 29 21:52:42 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 21:52:42 user nova-compute[75206]:         </nova:port>
Nov 29 21:52:42 user nova-compute[75206]:       </nova:ports>
Nov 29 21:52:42 user nova-compute[75206]:     </nova:instance>
Nov 29 21:52:42 user nova-compute[75206]:   </metadata>
Nov 29 21:52:42 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:52:42 user nova-compute[75206]:     <system>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="serial">39f1132e-912d-455d-8686-6bdaf870da24</entry>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="uuid">39f1132e-912d-455d-8686-6bdaf870da24</entry>
Nov 29 21:52:42 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:52:42 user nova-compute[75206]:     </system>
Nov 29 21:52:42 user nova-compute[75206]:   </sysinfo>
Nov 29 21:52:42 user nova-compute[75206]:   <os>
Nov 29 21:52:42 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:52:42 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:52:42 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:52:42 user nova-compute[75206]:   </os>
Nov 29 21:52:42 user nova-compute[75206]:   <features>
Nov 29 21:52:42 user nova-compute[75206]:     <acpi/>
Nov 29 21:52:42 user nova-compute[75206]:     <apic/>
Nov 29 21:52:42 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:52:42 user nova-compute[75206]:   </features>
Nov 29 21:52:42 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:52:42 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:52:42 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:52:42 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:52:42 user nova-compute[75206]:   </clock>
Nov 29 21:52:42 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:52:42 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:52:42 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:52:42 user nova-compute[75206]:   </cpu>
Nov 29 21:52:42 user nova-compute[75206]:   <devices>
Nov 29 21:52:42 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:52:42 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:52:42 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk"/>
Nov 29 21:52:42 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:52:42 user nova-compute[75206]:     </disk>
Nov 29 21:52:42 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:52:42 user nova-compute[75206]:       <mac address="fa:16:3e:6d:10:cd"/>
Nov 29 21:52:42 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:42 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:52:42 user nova-compute[75206]:       <target dev="tapa3b1902e-6a"/>
Nov 29 21:52:42 user nova-compute[75206]:     </interface>
Nov 29 21:52:42 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:52:42 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/console.log" append="off"/>
Nov 29 21:52:42 user nova-compute[75206]:     </serial>
Nov 29 21:52:42 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:52:42 user nova-compute[75206]:     <video>
Nov 29 21:52:42 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:52:42 user nova-compute[75206]:     </video>
Nov 29 21:52:42 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:52:42 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:52:42 user nova-compute[75206]:     </rng>
Nov 29 21:52:42 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:52:42 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:52:42 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:52:42 user nova-compute[75206]:     </memballoon>
Nov 29 21:52:42 user nova-compute[75206]:   </devices>
Nov 29 21:52:42 user nova-compute[75206]: </domain>
Nov 29 21:52:42 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-tempest.common.compute-instance-410845633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG os_vif [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8203b0-c8a1-5394-b06f-90ca1ca14784', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3b1902e-6a, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3b1902e-6a, col_values=(('qos', UUID('cfa530fc-9df4-4285-9133-633f83820bb5')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3b1902e-6a, col_values=(('external_ids', {'iface-id': 'a3b1902e-6a42-4849-8d5c-0567d9601b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:10:cd', 'vm-uuid': '39f1132e-912d-455d-8686-6bdaf870da24'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:42 user nova-compute[75206]: INFO os_vif [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a')
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:6d:10:cd, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updated VIF entry in instance network info cache for port a3b1902e-6a42-4849-8d5c-0567d9601b8f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG nova.network.neutron [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating instance_info_cache with network_info: [{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-926b1f4e-5749-4669-b3fe-db77c2a5e272 req-e5b8559d-ef4d-4b33-876d-4bd0e0553703 service nova] Releasing lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:44 user nova-compute[75206]: WARNING nova.compute.manager [req-93521ec9-e6db-4fe4-9493-41ed24994682 req-4b963e38-6457-427c-adf3-6d6bcfb34f40 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state building and task_state spawning.
Nov 29 21:52:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:52:46 user nova-compute[75206]: WARNING nova.compute.manager [req-13495f5c-6c3f-423a-8a20-ddb42dfe36c6 req-ee0ac3d8-1e48-45c5-b7e6-b7cf277352c3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state building and task_state spawning.
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:52:46 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance spawned successfully.
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:52:46 user nova-compute[75206]: INFO nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 29 21:52:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:52:46 user nova-compute[75206]: INFO nova.compute.manager [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Took 8.06 seconds to build instance.
Nov 29 21:52:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-688943e8-843b-49d5-836a-842e0eacca51 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.192s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:52:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing instance network info cache due to event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:52:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:52:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updated VIF entry in instance network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:52:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:52:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5224159-7e29-4e10-8417-67f98f3ef8e1 req-62f0618c-71ef-4627-8db1-07b22f4cdce8 service nova] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:52:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:52:58 user nova-compute[75206]: INFO nova.compute.manager [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] instance snapshotting
Nov 29 21:52:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Beginning live snapshot process
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8.delta 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:52:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8.delta 1073741824" returned: 0 in 0.054s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:52:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 21:53:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:53:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 21:53:01 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8.delta /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8.delta /opt/stack/data/nova/instances/snapshots/tmpglltzjcz/b1b78c9b5bd24c689f2876651168c5c8" returned: 0 in 0.488s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Snapshot extracted, beginning image upload
Nov 29 21:53:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing instance network info cache due to event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] Acquiring lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] Acquired lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:02 user nova-compute[75206]: INFO nova.compute.manager [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Attaching volume cc6cad93-523c-48a9-839b-73c7f99c614c to /dev/vdb
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.utils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbdfc49-ee05-4f4a-a33f-84e47137733b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb975adb-2e92-4548-aafb-354107d0842f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a271850-7fd6-4870-aaf5-a1a12843b0d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[350b0db4-1e17-4c77-96bb-7ff2c22e9312]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updated VIF entry in instance network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating instance_info_cache with network_info: [{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:53:02 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c40b56-fbcc-42b1-94b3-ca201076cec8]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG os_brick.utils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating existing volume attachment record: 8ff14d6b-a986-4978-b26c-c4ef8e3eaadc {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:53:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d2018f8b-abfe-4ab1-ab43-32ed4919d6ca req-fa1e4438-1d03-4d52-ac3f-b6269b56b3ac service nova] Releasing lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Snapshot image upload complete
Nov 29 21:53:04 user nova-compute[75206]: INFO nova.compute.manager [None req-918e3c1d-ff48-4d6f-bba8-e03706c4e59c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Took 5.56 seconds to snapshot the instance on the hypervisor.
Nov 29 21:53:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:53:06 user nova-compute[75206]: INFO nova.compute.claims [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Claim successful on node user
Nov 29 21:53:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:53:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:53:06 user nova-compute[75206]: DEBUG nova.policy [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79424ddb3af406d9ed8a1626a8f03ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffcb36d26c41cd99ccb16570f285dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:53:06 user nova-compute[75206]: INFO nova.virt.block_device [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Booting with blank volume at /dev/vda
Nov 29 21:53:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Successfully created port: ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Successfully updated port: ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-changed-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Refreshing instance network info cache due to event network-changed-ad25aa03-da97-4b67-92c6-ffe789c5f726. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] Acquiring lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance network_info: |[{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] Acquired lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Refreshing network info cache for port ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:53:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updated VIF entry in instance network info cache for port ad25aa03-da97-4b67-92c6-ffe789c5f726. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:53:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f59e8ac7-54f6-430c-a3f6-458ce83b96f5 req-ecf26b7c-942d-477f-9cc8-bca683e3bb65 service nova] Releasing lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f4c7f9-78a2-4218-b187-f0b0a14fa82f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff53e23-2f84-47d1-94aa-72c025f1434c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3841ef55-ef7f-49f3-830a-287a49cb4a94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c152850-f785-4f0e-83d7-6c71452e75c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:53:12 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:53:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[faec0260-1388-4687-bbb0-3bfb6c7a96e1]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:53:12 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating existing volume attachment record: 5da19311-4f20-490d-acb6-286d866fe9d5 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgwbJuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:53:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:53:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:53:13 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f8d6c-e1c5-493d-9aef-c780c83f3013]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:53:13 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[87386f69-c1a1-4a88-be5c-ad4fca9287ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c] added
Nov 29 21:53:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4ec2f-93ac-4f5a-a706-691f3754b882]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72beb25b-b759-4bf4-af0c-03ab38f812fc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgwbJuit {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgwbJuit" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb17b9-155d-4b01-9b06-ca9c662f3128]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgwbJuit'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eadd16-e5b4-46f0-a7ff-90e1abb97cc7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f82d3-41ef-4b5e-8055-6de70b856118]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:53:13 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:53:13 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:53:13 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 21:53:13 user nova-compute[75206]: 
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c7dcb-8d7f-412e-995f-c16982e903e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260]
Nov 29 21:53:13 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260] successful.
Nov 29 21:53:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6344e-97b9-4054-bcdb-ada57a116f35]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa3cdd-748a-46d8-880c-218df04e17c9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:13 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a5c18-f484-41ca-bbaa-17df75b7fdbe]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:53:13 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgwbJuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:53:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:53:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26431316165646266', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:53:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431316165646266', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:53:14 user nova-compute[75206]: DEBUG nova.objects.instance [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:53:14 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:53:14 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:53:14 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:53:14 user nova-compute[75206]:   <serial>cc6cad93-523c-48a9-839b-73c7f99c614c</serial>
Nov 29 21:53:14 user nova-compute[75206]: </disk>
Nov 29 21:53:14 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:53:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:53:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:53:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No VIF found with MAC fa:16:3e:9a:d9:7c, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:53:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-04ebc484-2fc7-48b5-8d4f-ab4d034f91ad tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.758s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:17 user nova-compute[75206]: INFO nova.compute.manager [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Detaching volume cc6cad93-523c-48a9-839b-73c7f99c614c
Nov 29 21:53:17 user nova-compute[75206]: INFO nova.virt.block_device [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Attempting to driver detach volume cc6cad93-523c-48a9-839b-73c7f99c614c from mountpoint /dev/vdb
Nov 29 21:53:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Attempting to detach device vdb from instance bd696537-2a16-49bf-b4aa-f3bb98ec609f from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:53:17 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:53:17 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:53:17 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:53:17 user nova-compute[75206]:   <serial>cc6cad93-523c-48a9-839b-73c7f99c614c</serial>
Nov 29 21:53:17 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:53:17 user nova-compute[75206]: </disk>
Nov 29 21:53:17 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:53:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully detached device vdb from instance bd696537-2a16-49bf-b4aa-f3bb98ec609f from the persistent domain config.
Nov 29 21:53:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd696537-2a16-49bf-b4aa-f3bb98ec609f from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:53:17 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:53:17 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:53:17 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:53:17 user nova-compute[75206]:   <serial>cc6cad93-523c-48a9-839b-73c7f99c614c</serial>
Nov 29 21:53:17 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:53:17 user nova-compute[75206]: </disk>
Nov 29 21:53:17 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:53:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:53:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Creating image(s)
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Ensure instance console log exists: /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start _get_guest_xml network_info=[{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5da19311-4f20-490d-acb6-286d866fe9d5', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3083fb2-1acb-4cef-9ca0-061c1b1ab540', 'attached_at': '', 'detached_at': '', 'volume_id': '2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'serial': '2ccb91f2-1228-4db3-9d7f-02e79744c4f0'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:53:20 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:20 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:53:20 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:53:20 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:53:20 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[134b317f-2132-4556-8905-50bf9bf09cab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:53:20 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f49fb6d-eb23-4dcc-baac-2db485b6c077]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0] added
Nov 29 21:53:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[648df88f-03aa-4f25-9ea4-9ef8b384a681]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec4f53-3d58-44c2-b6ea-157ebec2a1ef]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpRKyjYE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpRKyjYE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1bfc7c-155d-4181-b97b-e4afefac45f7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpRKyjYE'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acd0253-41fd-4551-9934-ff6983d5dccb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02571a-8138-4623-87f1-38a853a82559]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:53:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeef65f-2cd3-4fd9-92a0-1fbd025b41e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260]
Nov 29 21:53:21 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260] successful.
Nov 29 21:53:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1a13b1-10b6-4edc-93e5-2836ec31dec8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e909872-561e-4e22-a39b-4c8145a58854]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:21 user nova-compute[75206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:53:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:21 user nova-compute[75206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:53:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce598e-4200-419d-bcb9-4061e7ac7475]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:53:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23437633961363664', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633961363664', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413138911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413138911',id=27,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-01h1cyi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:07Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=d3083fb2-1acb-4cef-9ca0-061c1b1ab540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:53:22 user nova-compute[75206]:   <uuid>d3083fb2-1acb-4cef-9ca0-061c1b1ab540</uuid>
Nov 29 21:53:22 user nova-compute[75206]:   <name>instance-0000001b</name>
Nov 29 21:53:22 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:53:22 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:53:22 user nova-compute[75206]:   <metadata>
Nov 29 21:53:22 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:53:22 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-413138911</nova:name>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:53:20</nova:creationTime>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:53:22 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:53:22 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:owner>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 21:53:22 user nova-compute[75206]:       </nova:owner>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:53:22 user nova-compute[75206]:       <nova:ports>
Nov 29 21:53:22 user nova-compute[75206]:         <nova:port uuid="ad25aa03-da97-4b67-92c6-ffe789c5f726">
Nov 29 21:53:22 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 21:53:22 user nova-compute[75206]:         </nova:port>
Nov 29 21:53:22 user nova-compute[75206]:       </nova:ports>
Nov 29 21:53:22 user nova-compute[75206]:     </nova:instance>
Nov 29 21:53:22 user nova-compute[75206]:   </metadata>
Nov 29 21:53:22 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:53:22 user nova-compute[75206]:     <system>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="serial">d3083fb2-1acb-4cef-9ca0-061c1b1ab540</entry>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="uuid">d3083fb2-1acb-4cef-9ca0-061c1b1ab540</entry>
Nov 29 21:53:22 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:53:22 user nova-compute[75206]:     </system>
Nov 29 21:53:22 user nova-compute[75206]:   </sysinfo>
Nov 29 21:53:22 user nova-compute[75206]:   <os>
Nov 29 21:53:22 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:53:22 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:53:22 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:53:22 user nova-compute[75206]:   </os>
Nov 29 21:53:22 user nova-compute[75206]:   <features>
Nov 29 21:53:22 user nova-compute[75206]:     <acpi/>
Nov 29 21:53:22 user nova-compute[75206]:     <apic/>
Nov 29 21:53:22 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:53:22 user nova-compute[75206]:   </features>
Nov 29 21:53:22 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:53:22 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:53:22 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:53:22 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:53:22 user nova-compute[75206]:   </clock>
Nov 29 21:53:22 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:53:22 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:53:22 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:53:22 user nova-compute[75206]:   </cpu>
Nov 29 21:53:22 user nova-compute[75206]:   <devices>
Nov 29 21:53:22 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:53:22 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:53:22 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 21:53:22 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:53:22 user nova-compute[75206]:       <serial>2ccb91f2-1228-4db3-9d7f-02e79744c4f0</serial>
Nov 29 21:53:22 user nova-compute[75206]:     </disk>
Nov 29 21:53:22 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:53:22 user nova-compute[75206]:       <mac address="fa:16:3e:c5:9e:15"/>
Nov 29 21:53:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:53:22 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:53:22 user nova-compute[75206]:       <target dev="tapad25aa03-da"/>
Nov 29 21:53:22 user nova-compute[75206]:     </interface>
Nov 29 21:53:22 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:53:22 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/console.log" append="off"/>
Nov 29 21:53:22 user nova-compute[75206]:     </serial>
Nov 29 21:53:22 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:53:22 user nova-compute[75206]:     <video>
Nov 29 21:53:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:53:22 user nova-compute[75206]:     </video>
Nov 29 21:53:22 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:53:22 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:53:22 user nova-compute[75206]:     </rng>
Nov 29 21:53:22 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:53:22 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:53:22 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:53:22 user nova-compute[75206]:     </memballoon>
Nov 29 21:53:22 user nova-compute[75206]:   </devices>
Nov 29 21:53:22 user nova-compute[75206]: </domain>
Nov 29 21:53:22 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413138911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413138911',id=27,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-01h1cyi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:07Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=d3083fb2-1acb-4cef-9ca0-061c1b1ab540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG os_vif [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df969e56-1362-5ae5-9269-d868d25bcf3e', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad25aa03-da, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad25aa03-da, col_values=(('qos', UUID('e303e200-4c4b-4b81-9dda-c373e7b0beff')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad25aa03-da, col_values=(('external_ids', {'iface-id': 'ad25aa03-da97-4b67-92c6-ffe789c5f726', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:9e:15', 'vm-uuid': 'd3083fb2-1acb-4cef-9ca0-061c1b1ab540'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:22 user nova-compute[75206]: INFO os_vif [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da')
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:c5:9e:15, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:24 user nova-compute[75206]: WARNING nova.compute.manager [req-7a6b929f-2ccf-41f9-b47d-26fffcd5ed64 req-d2668c77-3a5f-49f6-85d2-6388c6e2b21f service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state building and task_state spawning.
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:53:25 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance spawned successfully.
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:26 user nova-compute[75206]: INFO nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 29 21:53:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:26 user nova-compute[75206]: INFO nova.compute.manager [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Took 20.08 seconds to build instance.
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-abe39cb2-a7e6-477c-a6d9-5dd42a57c576 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.195s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:26 user nova-compute[75206]: WARNING nova.compute.manager [req-eb7415e1-e3cc-4238-857e-05d21e087fa7 req-7914abae-92d3-4716-9d09-e61babb20242 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state None.
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:27 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:27 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=25.16103744506836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 20aae253-226e-4930-8d9a-42993b9a6027 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f603593a-9ed6-4750-be67-8004112c5093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:53:27 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:53:28 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:53:28 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:53:28 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:53:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:53:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updating instance_info_cache with network_info: [{"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-93c88682-7fb9-437f-9023-dc7dc9490205" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:53:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:37 user nova-compute[75206]: INFO nova.compute.manager [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Terminating instance
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-unplugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] No waiting events found dispatching network-vif-unplugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-fd48a5e4-5ff2-433d-837a-2c1bcbea8137 req-45216856-34d5-48dc-8d73-4cd47000b61f service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-unplugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Instance destroyed successfully.
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lazy-loading 'resources' on Instance uuid 20aae253-226e-4930-8d9a-42993b9a6027 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1539292106',display_name='tempest-ServersNegativeTestJSON-server-1539292106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1539292106',id=24,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:51:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-l2x8utfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:51:55Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=20aae253-226e-4930-8d9a-42993b9a6027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "address": "fa:16:3e:00:9e:96", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaff5fa5-f5", "ovs_interfaceid": "aaff5fa5-f5be-4863-a3da-983a76c7d0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG os_vif [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaff5fa5-f5, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eb1a111-b770-4559-ae47-8b461717e8ad) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:37 user nova-compute[75206]: INFO os_vif [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:96,bridge_name='br-int',has_traffic_filtering=True,id=aaff5fa5-f5be-4863-a3da-983a76c7d0c0,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaff5fa5-f5')
Nov 29 21:53:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Deleting instance files /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027_del
Nov 29 21:53:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Deletion of /opt/stack/data/nova/instances/20aae253-226e-4930-8d9a-42993b9a6027_del complete
Nov 29 21:53:38 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd696537-2a16-49bf-b4aa-f3bb98ec609f is timed out.
Nov 29 21:53:38 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully detached device vdb from instance bd696537-2a16-49bf-b4aa-f3bb98ec609f from the live domain config.
Nov 29 21:53:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgwbJuit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:53:38 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: INFO nova.compute.manager [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da7c85-6248-4ec6-9c85-f8bb13ac3a88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:53:38 user nova-compute[75206]: No targets found.
Nov 29 21:53:38 user nova-compute[75206]: iSNS:
Nov 29 21:53:38 user nova-compute[75206]: No targets found.
Nov 29 21:53:38 user nova-compute[75206]: STATIC:
Nov 29 21:53:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:53:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:53:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:53:38 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c
Nov 29 21:53:38 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:53:38 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:53:38 user nova-compute[75206]: FIRMWARE:
Nov 29 21:53:38 user nova-compute[75206]: No targets found.
Nov 29 21:53:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:53:38 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:53:38 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1740e7a-da3a-4b13-a19a-4e608b3730ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc829662-71d3-4ef4-91cb-2bafd1595c0b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:38 user nova-compute[75206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:53:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c (non-flash)
Nov 29 21:53:38 user nova-compute[75206]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:53:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8160670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc07760-65d1-43a7-b2f5-54fef9eaa81f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1be65de-73f8-40ae-88d3-f9b3a0e63b62]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e3b32-673c-4cfe-b59d-619a8092671d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce935e27-df06-4502-b262-1e45a69b10dd]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a342922f-9c22-45c4-b62b-a009502f9838]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3786f27-bc62-4cfc-ab3f-4c1ab86c0d9b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260]
Nov 29 21:53:38 user nova-compute[75206]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c, portal: 172.16.0.220,3260] successful.
Nov 29 21:53:38 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc6cad93-523c-48a9-839b-73c7f99c614c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d973387-a2da-4939-92cf-6ebafa25980f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== disconnect_volume: return (348ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:38 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Took 0.58 seconds to deallocate network for instance.
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:39 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Deleted allocations for instance 20aae253-226e-4930-8d9a-42993b9a6027
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b3fef030-64a1-45ce-a3cc-87ee0f0923f7 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "20aae253-226e-4930-8d9a-42993b9a6027" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c23e83e1-4d4b-48bd-856f-5e38ffd37d9d tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] Acquiring lock "20aae253-226e-4930-8d9a-42993b9a6027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] Lock "20aae253-226e-4930-8d9a-42993b9a6027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] No waiting events found dispatching network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:39 user nova-compute[75206]: WARNING nova.compute.manager [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received unexpected event network-vif-plugged-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 for instance with vm_state deleted and task_state None.
Nov 29 21:53:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-a1b3834c-7e74-48a2-898c-d4258c568e6a req-f427353e-6b0f-479e-ba9e-d6f8b50def28 service nova] [instance: 20aae253-226e-4930-8d9a-42993b9a6027] Received event network-vif-deleted-aaff5fa5-f5be-4863-a3da-983a76c7d0c0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:53:41 user nova-compute[75206]: INFO nova.compute.claims [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Claim successful on node user
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:53:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.policy [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e456426697854165bbdd8d8f4a39cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84edc3e740a04e4eb7cdec55bbc1f4c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:53:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Creating image(s)
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Successfully created port: aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.virt.images [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] a27033a8-5eb8-4ee1-a037-38ac6f138341 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.part /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.part /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.converted" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.938s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Successfully updated port: aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing instance network info cache due to event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b,backing_fmt=raw /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b,backing_fmt=raw /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk 1073741824" returned: 0 in 0.049s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "142d33025bc4e6504cd8767e07802f3915fc8e7b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Cannot resize image /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Ensure instance console log exists: /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance network_info: |[{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start _get_guest_xml network_info=[{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:53:38Z,direct_url=<?>,disk_format='qcow2',id=a27033a8-5eb8-4ee1-a037-38ac6f138341,min_disk=0,min_ram=0,name='tempest-scenario-img--471966684',owner='84edc3e740a04e4eb7cdec55bbc1f4c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:53:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a27033a8-5eb8-4ee1-a037-38ac6f138341'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:53:43 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:43 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:53:38Z,direct_url=<?>,disk_format='qcow2',id=a27033a8-5eb8-4ee1-a037-38ac6f138341,min_disk=0,min_ram=0,name='tempest-scenario-img--471966684',owner='84edc3e740a04e4eb7cdec55bbc1f4c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:53:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:42Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'pci_devices' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:53:43 user nova-compute[75206]:   <uuid>c7629b50-8d89-407c-b868-d265a029bf32</uuid>
Nov 29 21:53:43 user nova-compute[75206]:   <name>instance-0000001c</name>
Nov 29 21:53:43 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:53:43 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:53:43 user nova-compute[75206]:   <metadata>
Nov 29 21:53:43 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:53:43 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:name>tempest-TestMinimumBasicScenario-server-1507297911</nova:name>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:53:43</nova:creationTime>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:53:43 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:53:43 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:owner>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:user uuid="e456426697854165bbdd8d8f4a39cd77">tempest-TestMinimumBasicScenario-2060893910-project-member</nova:user>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:project uuid="84edc3e740a04e4eb7cdec55bbc1f4c9">tempest-TestMinimumBasicScenario-2060893910</nova:project>
Nov 29 21:53:43 user nova-compute[75206]:       </nova:owner>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:root type="image" uuid="a27033a8-5eb8-4ee1-a037-38ac6f138341"/>
Nov 29 21:53:43 user nova-compute[75206]:       <nova:ports>
Nov 29 21:53:43 user nova-compute[75206]:         <nova:port uuid="aa60ee0a-b766-405f-a218-28a936489eb9">
Nov 29 21:53:43 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:53:43 user nova-compute[75206]:         </nova:port>
Nov 29 21:53:43 user nova-compute[75206]:       </nova:ports>
Nov 29 21:53:43 user nova-compute[75206]:     </nova:instance>
Nov 29 21:53:43 user nova-compute[75206]:   </metadata>
Nov 29 21:53:43 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:53:43 user nova-compute[75206]:     <system>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="serial">c7629b50-8d89-407c-b868-d265a029bf32</entry>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="uuid">c7629b50-8d89-407c-b868-d265a029bf32</entry>
Nov 29 21:53:43 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:53:43 user nova-compute[75206]:     </system>
Nov 29 21:53:43 user nova-compute[75206]:   </sysinfo>
Nov 29 21:53:43 user nova-compute[75206]:   <os>
Nov 29 21:53:43 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:53:43 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:53:43 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:53:43 user nova-compute[75206]:   </os>
Nov 29 21:53:43 user nova-compute[75206]:   <features>
Nov 29 21:53:43 user nova-compute[75206]:     <acpi/>
Nov 29 21:53:43 user nova-compute[75206]:     <apic/>
Nov 29 21:53:43 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:53:43 user nova-compute[75206]:   </features>
Nov 29 21:53:43 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:53:43 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:53:43 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:53:43 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:53:43 user nova-compute[75206]:   </clock>
Nov 29 21:53:43 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:53:43 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:53:43 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:53:43 user nova-compute[75206]:   </cpu>
Nov 29 21:53:43 user nova-compute[75206]:   <devices>
Nov 29 21:53:43 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:53:43 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:53:43 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk"/>
Nov 29 21:53:43 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:53:43 user nova-compute[75206]:     </disk>
Nov 29 21:53:43 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:53:43 user nova-compute[75206]:       <mac address="fa:16:3e:53:72:a6"/>
Nov 29 21:53:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:53:43 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:53:43 user nova-compute[75206]:       <target dev="tapaa60ee0a-b7"/>
Nov 29 21:53:43 user nova-compute[75206]:     </interface>
Nov 29 21:53:43 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:53:43 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/console.log" append="off"/>
Nov 29 21:53:43 user nova-compute[75206]:     </serial>
Nov 29 21:53:43 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:53:43 user nova-compute[75206]:     <video>
Nov 29 21:53:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:53:43 user nova-compute[75206]:     </video>
Nov 29 21:53:43 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:53:43 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:53:43 user nova-compute[75206]:     </rng>
Nov 29 21:53:43 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:53:43 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:53:43 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:53:43 user nova-compute[75206]:     </memballoon>
Nov 29 21:53:43 user nova-compute[75206]:   </devices>
Nov 29 21:53:43 user nova-compute[75206]: </domain>
Nov 29 21:53:43 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:42Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG os_vif [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73748ceb-ed66-5bf3-8235-fb2eac6cce52', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa60ee0a-b7, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa60ee0a-b7, col_values=(('qos', UUID('7991e69a-86f1-4ac9-9a88-5f4734348c99')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa60ee0a-b7, col_values=(('external_ids', {'iface-id': 'aa60ee0a-b766-405f-a218-28a936489eb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:72:a6', 'vm-uuid': 'c7629b50-8d89-407c-b868-d265a029bf32'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:43 user nova-compute[75206]: INFO os_vif [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7')
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No VIF found with MAC fa:16:3e:53:72:a6, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updated VIF entry in instance network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG nova.network.neutron [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:53:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dbd33060-e6d3-49d7-a2ad-7ab82bc6836f req-989f7752-ccf5-42b2-a49a-c3ccc1d53c8c service nova] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:45 user nova-compute[75206]: WARNING nova.compute.manager [req-7b3f9c7d-0163-4fea-8030-fdb6dc5513e0 req-587acd14-b82f-46b7-8af2-7009438217f4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state building and task_state spawning.
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:53:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance spawned successfully.
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:53:47 user nova-compute[75206]: INFO nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:53:47 user nova-compute[75206]: WARNING nova.compute.manager [req-b49c84db-eda7-4544-b77b-6405aeb144a7 req-d7f037d3-8acf-43a8-ab85-6adef18014c6 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state building and task_state spawning.
Nov 29 21:53:47 user nova-compute[75206]: INFO nova.compute.manager [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Took 6.52 seconds to build instance.
Nov 29 21:53:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-762d0e19-a955-4fcc-b89e-7efa2931d444 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.640s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:53:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:53:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:54:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:54:12 user nova-compute[75206]: INFO nova.compute.manager [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] instance snapshotting
Nov 29 21:54:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Beginning live snapshot process
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f.delta 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f.delta 1073741824" returned: 0 in 0.052s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 21:54:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:54:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:54:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 21:54:15 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:54:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f.delta /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f.delta /opt/stack/data/nova/instances/snapshots/tmpeeyz2i0k/64f7b41ae4d94507a5ba2f4f7e39112f" returned: 0 in 0.419s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Snapshot extracted, beginning image upload
Nov 29 21:54:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Snapshot image upload complete
Nov 29 21:54:17 user nova-compute[75206]: INFO nova.compute.manager [None req-bd05e80f-d8e3-48da-b470-68c22b09ed73 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Took 4.98 seconds to snapshot the instance on the hypervisor.
Nov 29 21:54:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:19 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:54:19 user nova-compute[75206]: INFO nova.compute.claims [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Claim successful on node user
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:54:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.policy [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e74a3cb54432457683dd38e8363528e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049af7fc294f49358608d0ab6a9b8d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:54:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Creating image(s)
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "/opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "/opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Successfully created port: e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG nova.virt.images [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] 7f37fd7d-91c5-48e2-9722-ef38b6b45775 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.part /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.part /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.converted" returned: 0 in 0.230s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.389s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:21 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Successfully updated port: e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing instance network info cache due to event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] Acquiring lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] Acquired lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing network info cache for port e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json" returned: 0 in 0.213s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6bd6bdd3-71ca-4556-bedc-fda0d68d8815 req-bb1c849c-d670-4065-944b-748fb6288fb7 service nova] Releasing lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquired lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4,backing_fmt=raw /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4,backing_fmt=raw /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk 1073741824" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "b4b1be8bf6562aea7579714b9d445823bb3d11c4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Ensure instance console log exists: /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating instance_info_cache with network_info: [{"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Releasing lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance network_info: |[{"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Start _get_guest_xml network_info=[{"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='900d03efe5df2790962b5b17a2909783',container_format='bare',created_at=2023-11-29T21:54:13Z,direct_url=<?>,disk_format='qcow2',id=7f37fd7d-91c5-48e2-9722-ef38b6b45775,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-854990071',owner='049af7fc294f49358608d0ab6a9b8d4f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T21:54:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '7f37fd7d-91c5-48e2-9722-ef38b6b45775'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:54:22 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:54:22 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='900d03efe5df2790962b5b17a2909783',container_format='bare',created_at=2023-11-29T21:54:13Z,direct_url=<?>,disk_format='qcow2',id=7f37fd7d-91c5-48e2-9722-ef38b6b45775,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-854990071',owner='049af7fc294f49358608d0ab6a9b8d4f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T21:54:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1777315192',display_name='tempest-TestStampPattern-server-1777315192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1777315192',id=29,image_ref='7f37fd7d-91c5-48e2-9722-ef38b6b45775',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-v7zgvy2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bd696537-2a16-49bf-b4aa-f3bb98ec609f',image_min_disk='1',image_min_ram='0',image_owner_id='049af7fc294f49358608d0ab6a9b8d4f',image_owner_project_name='tempest-TestStampPattern-1622973448',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1622973448-project-member',image_user_id='e74a3cb54432457683dd38e8363528e7',network_allocated='True',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:20Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=d7709e06-a10b-46e3-b834-a98c13f4e152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'pci_devices' on Instance uuid d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:54:22 user nova-compute[75206]:   <uuid>d7709e06-a10b-46e3-b834-a98c13f4e152</uuid>
Nov 29 21:54:22 user nova-compute[75206]:   <name>instance-0000001d</name>
Nov 29 21:54:22 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:54:22 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:54:22 user nova-compute[75206]:   <metadata>
Nov 29 21:54:22 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:54:22 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:name>tempest-TestStampPattern-server-1777315192</nova:name>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:54:22</nova:creationTime>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:54:22 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:54:22 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:owner>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:user uuid="e74a3cb54432457683dd38e8363528e7">tempest-TestStampPattern-1622973448-project-member</nova:user>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:project uuid="049af7fc294f49358608d0ab6a9b8d4f">tempest-TestStampPattern-1622973448</nova:project>
Nov 29 21:54:22 user nova-compute[75206]:       </nova:owner>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:root type="image" uuid="7f37fd7d-91c5-48e2-9722-ef38b6b45775"/>
Nov 29 21:54:22 user nova-compute[75206]:       <nova:ports>
Nov 29 21:54:22 user nova-compute[75206]:         <nova:port uuid="e25002f1-1f6a-44af-9cba-3993eb00c1a3">
Nov 29 21:54:22 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 21:54:22 user nova-compute[75206]:         </nova:port>
Nov 29 21:54:22 user nova-compute[75206]:       </nova:ports>
Nov 29 21:54:22 user nova-compute[75206]:     </nova:instance>
Nov 29 21:54:22 user nova-compute[75206]:   </metadata>
Nov 29 21:54:22 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:54:22 user nova-compute[75206]:     <system>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="serial">d7709e06-a10b-46e3-b834-a98c13f4e152</entry>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="uuid">d7709e06-a10b-46e3-b834-a98c13f4e152</entry>
Nov 29 21:54:22 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:54:22 user nova-compute[75206]:     </system>
Nov 29 21:54:22 user nova-compute[75206]:   </sysinfo>
Nov 29 21:54:22 user nova-compute[75206]:   <os>
Nov 29 21:54:22 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:54:22 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:54:22 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:54:22 user nova-compute[75206]:   </os>
Nov 29 21:54:22 user nova-compute[75206]:   <features>
Nov 29 21:54:22 user nova-compute[75206]:     <acpi/>
Nov 29 21:54:22 user nova-compute[75206]:     <apic/>
Nov 29 21:54:22 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:54:22 user nova-compute[75206]:   </features>
Nov 29 21:54:22 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:54:22 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:54:22 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:54:22 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:54:22 user nova-compute[75206]:   </clock>
Nov 29 21:54:22 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:54:22 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:54:22 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:54:22 user nova-compute[75206]:   </cpu>
Nov 29 21:54:22 user nova-compute[75206]:   <devices>
Nov 29 21:54:22 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:54:22 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:54:22 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk"/>
Nov 29 21:54:22 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:54:22 user nova-compute[75206]:     </disk>
Nov 29 21:54:22 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:54:22 user nova-compute[75206]:       <mac address="fa:16:3e:83:8e:2b"/>
Nov 29 21:54:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:54:22 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:54:22 user nova-compute[75206]:       <target dev="tape25002f1-1f"/>
Nov 29 21:54:22 user nova-compute[75206]:     </interface>
Nov 29 21:54:22 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:54:22 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/console.log" append="off"/>
Nov 29 21:54:22 user nova-compute[75206]:     </serial>
Nov 29 21:54:22 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:54:22 user nova-compute[75206]:     <video>
Nov 29 21:54:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:54:22 user nova-compute[75206]:     </video>
Nov 29 21:54:22 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:54:22 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:54:22 user nova-compute[75206]:     </rng>
Nov 29 21:54:22 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:54:22 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:54:22 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:54:22 user nova-compute[75206]:     </memballoon>
Nov 29 21:54:22 user nova-compute[75206]:   </devices>
Nov 29 21:54:22 user nova-compute[75206]: </domain>
Nov 29 21:54:22 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1777315192',display_name='tempest-TestStampPattern-server-1777315192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1777315192',id=29,image_ref='7f37fd7d-91c5-48e2-9722-ef38b6b45775',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-v7zgvy2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bd696537-2a16-49bf-b4aa-f3bb98ec609f',image_min_disk='1',image_min_ram='0',image_owner_id='049af7fc294f49358608d0ab6a9b8d4f',image_owner_project_name='tempest-TestStampPattern-1622973448',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1622973448-project-member',image_user_id='e74a3cb54432457683dd38e8363528e7',network_allocated='True',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:20Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=d7709e06-a10b-46e3-b834-a98c13f4e152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG os_vif [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea341ddc-83b7-541b-b279-2a0c831f845b', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape25002f1-1f, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape25002f1-1f, col_values=(('qos', UUID('c46f607e-5c0c-4686-b770-fa5af89a552c')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape25002f1-1f, col_values=(('external_ids', {'iface-id': 'e25002f1-1f6a-44af-9cba-3993eb00c1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8e:2b', 'vm-uuid': 'd7709e06-a10b-46e3-b834-a98c13f4e152'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:22 user nova-compute[75206]: INFO os_vif [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f')
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No VIF found with MAC fa:16:3e:83:8e:2b, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-changed-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Refreshing instance network info cache due to event network-changed-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] Acquiring lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] Acquired lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.network.neutron [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Refreshing network info cache for port fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.network.neutron [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updated VIF entry in instance network info cache for port fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.network.neutron [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updating instance_info_cache with network_info: [{"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1b85bb06-06ca-4001-820c-8083a0323699 req-e0b7064e-b75b-41b5-9351-f5def02018b9 service nova] Releasing lock "refresh_cache-f603593a-9ed6-4750-be67-8004112c5093" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:54:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] No waiting events found dispatching network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:26 user nova-compute[75206]: WARNING nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received unexpected event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 for instance with vm_state building and task_state spawning.
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] No waiting events found dispatching network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:26 user nova-compute[75206]: WARNING nova.compute.manager [req-1f9b4e5b-a627-410e-88f2-cf3b002c8277 req-0644d4e9-1e15-4d83-898e-b5cfc0ee80d6 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received unexpected event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 for instance with vm_state building and task_state spawning.
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:54:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance spawned successfully.
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:26 user nova-compute[75206]: INFO nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 29 21:54:26 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:54:26 user nova-compute[75206]: INFO nova.compute.manager [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Took 7.21 seconds to build instance.
Nov 29 21:54:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b430a295-a3cf-44b7-a3aa-cfeff1d8ae27 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.319s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:28 user nova-compute[75206]: INFO nova.compute.manager [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Attaching volume bd783eb7-80c5-4fd4-90d6-e5646ec04411 to /dev/vdb
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad40d8-99e6-4b82-8c23-3c18ffc3d01c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90007b47-5fa7-41bf-8cef-77fd530a1eaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588dfe5-3887-4daf-9400-5c09b7c89ff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55843715-8bf1-44b5-9cac-9e39c8d7d0ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:28 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86381ad-0709-407e-b7a8-e8d7b0389b9b]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updating existing volume attachment record: fe34f2ed-ace8-44f5-a3b9-b095ce4d83f5 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-changed-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Refreshing instance network info cache due to event network-changed-a3b1902e-6a42-4849-8d5c-0567d9601b8f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] Acquiring lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] Acquired lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG nova.network.neutron [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Refreshing network info cache for port a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG nova.objects.instance [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'flavor' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG nova.network.neutron [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updated VIF entry in instance network info cache for port a3b1902e-6a42-4849-8d5c-0567d9601b8f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG nova.network.neutron [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating instance_info_cache with network_info: [{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-92b2ab2d-612a-4850-9adb-e3200589d3f9 req-dfc1199b-50f7-40a5-9674-28ddc54e612f service nova] Releasing lock "refresh_cache-39f1132e-912d-455d-8686-6bdaf870da24" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:31 user nova-compute[75206]: INFO nova.compute.manager [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attaching volume 7cebc9d1-065e-4582-97cc-992a86558855 to /dev/vdb
Nov 29 21:54:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:54:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7388MB free_disk=24.943408966064453GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.utils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04b4b8-4d46-4a7f-a8d9-6f337bce193c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eea470-dd98-4aa4-bffd-55f34da28d9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[daccd115-96da-4f29-91be-3ec2fc635ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b9eb86-7815-4a86-a57a-16e199a20d92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:31 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce3f561-e948-4766-ab85-877ff793b933]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG os_brick.utils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating existing volume attachment record: 49d27a42-b070-41f5-a04e-4995f913b898 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f603593a-9ed6-4750-be67-8004112c5093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c7629b50-8d89-407c-b868-d265a029bf32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d7709e06-a10b-46e3-b834-a98c13f4e152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG nova.objects.instance [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'flavor' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:35 user nova-compute[75206]: INFO nova.compute.manager [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Attaching volume fd1ecab4-3282-4065-b907-c3d5ab205bff to /dev/vdb
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b1de3c-d75f-4da5-88a5-98d6e888d542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce3158-3e7a-4357-bf53-c1e461c79e94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23bbff-6d46-4239-abcd-920351ca3047]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a159fbd6-6771-4e8c-b811-2f305f59683c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:35 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:54:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53667b-8f6b-419b-a8dd-e44009b86858]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:35 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating existing volume attachment record: f853b36f-260e-480d-b387-83d90a91823b {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:54:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:43 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:43 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:43 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12105d-cc49-4e5f-9e3c-4932e12e5c24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:54:43 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[196910e8-a307-44e0-bb77-0d94353f3d79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added
Nov 29 21:54:43 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cc8ec-c5f7-4a4a-a4c5-37facc2cfe25]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a0f58d-ca73-4324-8824-87977b7e9349]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29cd3fe-18e5-4cbd-a1a4-bf6da86eac88]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNCtFRvT'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c31f03-bcb0-481a-9894-7a01ef61acfd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7cc00-17f5-40a2-b240-fb54bf983523]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:43 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:43 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f692d4-66c9-4e99-b974-4793ce87f094]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:54:44 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:54:44 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffedb7ab-d0d9-483e-bd23-2eacc7d87bb6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce31e7-f8d0-4acb-90b2-b0f88901d25e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:44 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:44 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:44 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:44 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d18a352-b38b-4818-ad47-5aa7bce9608f]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:44 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.objects.instance [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'flavor' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:54:45 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:45 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:54:45 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:45 user nova-compute[75206]:   <serial>fd1ecab4-3282-4065-b907-c3d5ab205bff</serial>
Nov 29 21:54:45 user nova-compute[75206]: </disk>
Nov 29 21:54:45 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXefPcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:45 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27619a-b2c9-4cb6-839f-63b3f4d4bbf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:54:45 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f1fd91-a18e-4f56-97c0-15c50e0811c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411] added
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[768e78e5-01c7-4541-8653-256c45712b0e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e95552-c20f-445e-97ed-ec380bb86b62]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sXefPcwI {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sXefPcwI" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3789e1-3186-4c3b-a14a-5f67a1bbbb92]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sXefPcwI'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8460a0fc-a372-4db3-8bdd-62f77d9311d9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17147b16-8089-4d02-b10a-f15d44f8e35f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf69f38-6778-45be-9201-1da017f8538a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260]
Nov 29 21:54:45 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260] successful.
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a2a5e-77fb-4f16-a920-4570a8ba392d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba9b844-a3a2-486b-b39d-ec579ae8ca72]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:45 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No VIF found with MAC fa:16:3e:2d:f2:ae, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce064a4-e7d8-4014-87df-bc6a3a6737fc]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXefPcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:54:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-48fcf4e2-d3cf-4a1c-b789-0eb1a5dfbf1e tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.520s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26534323339626238', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534323339626238', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:46 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:46 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[376cb80b-2fab-47aa-b78e-0ad886787c64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:54:46 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:54:46 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:46 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 21:54:46 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:46 user nova-compute[75206]:   <serial>bd783eb7-80c5-4fd4-90d6-e5646ec04411</serial>
Nov 29 21:54:46 user nova-compute[75206]: </disk>
Nov 29 21:54:46 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d66867-57f2-40b7-9a2d-b83dd151ce25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855] added
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9279b17d-96f0-4c38-9168-e79597ee5fbe]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[221aca38-c0c4-474d-9a0c-acefc3e3defc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGEnlbiR {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGEnlbiR" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d913dd3-3507-400c-b662-5fd0c7a27dd1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kGEnlbiR'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ba605-a8e4-405e-a311-8af6058691f5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f0574-5e7f-4f5b-b973-c4022e7ed4b5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a4e266-1cbd-424c-bb34-781b7ed54f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]
Nov 29 21:54:46 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec28836f-e36f-45ce-9af3-2638735cf7af]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c6e76-8dd1-4b0e-8742-0d542d4c1fb0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e9170-0f3f-448c-9c2d-8932367935b5]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:20:2e:73, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d7d7f41c-c63c-49b1-90ca-1790eaa388ed tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.668s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== connect_volume: return (2648ms) {'type': 'block', 'scsi_wwn': '23765323337326233', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323337326233', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'flavor' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:54:47 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:47 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:54:47 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:47 user nova-compute[75206]:   <serial>7cebc9d1-065e-4582-97cc-992a86558855</serial>
Nov 29 21:54:47 user nova-compute[75206]: </disk>
Nov 29 21:54:47 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Stashing vm_state: active {{(pid=75206) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.compute.claims [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Claim successful on node user
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating resource usage from migration fd56d3e5-c907-4450-a3f6-a77579e4dabd
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:6d:10:cd, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-963e6f56-4061-41a6-8580-777d59232c43 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.538s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.compute.manager [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Detaching volume bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.virt.block_device [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Attempting to driver detach volume bd783eb7-80c5-4fd4-90d6-e5646ec04411 from mountpoint /dev/vdb
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Attempting to detach device vdb from instance f603593a-9ed6-4750-be67-8004112c5093 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:54:48 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:48 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 21:54:48 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:48 user nova-compute[75206]:   <serial>bd783eb7-80c5-4fd4-90d6-e5646ec04411</serial>
Nov 29 21:54:48 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:54:48 user nova-compute[75206]: </disk>
Nov 29 21:54:48 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance f603593a-9ed6-4750-be67-8004112c5093 from the persistent domain config.
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f603593a-9ed6-4750-be67-8004112c5093 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:54:48 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:48 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 21:54:48 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:48 user nova-compute[75206]:   <serial>bd783eb7-80c5-4fd4-90d6-e5646ec04411</serial>
Nov 29 21:54:48 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:54:48 user nova-compute[75206]: </disk>
Nov 29 21:54:48 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.598s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.compute.manager [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Migrating
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:48 user nova-compute[75206]: INFO nova.compute.rpcapi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Starting migrate_disk_and_power_off {{(pid=75206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:49 user nova-compute[75206]: WARNING nova.compute.manager [req-88253b01-9faf-41a3-9c8f-cb10de754e40 req-38273e5d-8da4-4839-a876-ef2acd17e126 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state active and task_state resize_migrating.
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'flavor' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:54:50 user nova-compute[75206]: INFO nova.compute.manager [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Rebuilding instance
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance destroyed successfully.
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebe76bc7-48, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff8b5838-117d-466a-a1c5-72f770ef825c) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:54:50 user nova-compute[75206]: INFO os_vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:50 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2160a52-a0f4-490f-935c-16092b5690fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:54:50 user nova-compute[75206]: No targets found.
Nov 29 21:54:50 user nova-compute[75206]: iSNS:
Nov 29 21:54:50 user nova-compute[75206]: No targets found.
Nov 29 21:54:50 user nova-compute[75206]: STATIC:
Nov 29 21:54:50 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:54:50 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:50 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:50 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:54:50 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:50 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:50 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:54:50 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:50 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:50 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:54:50 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:50 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:50 user nova-compute[75206]: FIRMWARE:
Nov 29 21:54:50 user nova-compute[75206]: No targets found.
Nov 29 21:54:50 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:54:50 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:54:50 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a0a200-640e-47b4-a9a5-43c08ad9dd89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:50 user nova-compute[75206]: INFO nova.compute.manager [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attaching volume 93ded810-c10f-48a3-9277-ed738d710552 to /dev/vdb
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fed38a-d6b1-4861-9fb2-b3fcad68cb68]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:50 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8079630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[597ef662-f45c-47a8-bb53-31038771be62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b603ab-98d3-4b0e-93ad-9b074d287e8c]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a3b38-d23f-4ad5-a245-76c986599dd4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f682c-e8b9-4ba9-81c6-d24ce023cd98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45078a9-520c-4358-ab92-80892d3aab7a]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0014c-feea-485e-841a-2ce086fdf6e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a6e2e4-ad84-427b-88a4-553589ff8b49]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2fc294-f937-4cf4-add6-0cb680c1744f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fb1de-78c9-41df-a6bd-50ea90d195b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:50 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f63106-f2c7-4722-8ec4-f2ade79d26de]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating existing volume attachment record: 8a0e4eb5-d3a5-4be7-bc40-4e8eb13f6e58 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:50 user nova-compute[75206]: WARNING nova.compute.manager [req-fad292db-fe82-4546-a495-91e3120377bf req-01bd0713-b3f5-4a02-b7a2-17c6b1b0f592 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state active and task_state rebuilding.
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0190de8-bbbc-420e-87d2-65fd397458ad]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:54:50 user nova-compute[75206]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:54:50 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d949b-b900-4dea-88cc-8688aff58d7f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== disconnect_volume: return (397ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:54:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_resize/disk /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance destroyed successfully.
Nov 29 21:54:51 user nova-compute[75206]: INFO nova.compute.manager [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Detaching volume 7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:54:51 user nova-compute[75206]: INFO nova.virt.block_device [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attempting to driver detach volume 7cebc9d1-065e-4582-97cc-992a86558855 from mountpoint /dev/vdb
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Attempting to detach device vdb from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:54:51 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:54:51 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:54:51 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:54:51 user nova-compute[75206]:   <serial>7cebc9d1-065e-4582-97cc-992a86558855</serial>
Nov 29 21:54:51 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:54:51 user nova-compute[75206]: </disk>
Nov 29 21:54:51 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:54:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully detached device vdb from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the persistent domain config.
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:51 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d534a3-24ad-44e7-8d3e-e90f138ef2d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:54:51 user nova-compute[75206]: No targets found.
Nov 29 21:54:51 user nova-compute[75206]: iSNS:
Nov 29 21:54:51 user nova-compute[75206]: No targets found.
Nov 29 21:54:51 user nova-compute[75206]: STATIC:
Nov 29 21:54:51 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:54:51 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:51 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:51 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:54:51 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:51 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:51 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:54:51 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:54:51 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:54:51 user nova-compute[75206]: FIRMWARE:
Nov 29 21:54:51 user nova-compute[75206]: No targets found.
Nov 29 21:54:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:54:51 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:54:51 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5d4b5-a6ea-42a9-88bd-682b8dc150ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[118cf4f1-f2ab-44e2-8e21-03d87157428a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:54:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8465630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a174f6-e5c0-4b55-970e-a35e3820510e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7d4571-cf98-4f2d-ba43-57c66afd1426]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "cp -r /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_resize/disk /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk" returned: 0 in 0.414s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_resize/disk.info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk.info {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6368d91e-e344-4ea7-a6a8-33bb2a1050f7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "cp -r /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_resize/disk.info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk.info" returned: 0 in 0.045s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c68009-b258-4a8a-a735-2073d10e998b]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949c627-4a08-49f3-8cef-c9825ba1e33f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a5b5c7-cc61-4564-a396-81c1e684b2d3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]
Nov 29 21:54:51 user nova-compute[75206]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.
Nov 29 21:54:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d8462-b7dc-4798-93cf-6163e02b75bf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== disconnect_volume: return (360ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:51 user nova-compute[75206]: WARNING nova.compute.manager [req-a200fa30-7531-4e2a-a382-7c50b909c39a req-2d0601b0-8aa6-4daf-a05f-e76d8c24cdc5 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state active and task_state resize_migrating.
Nov 29 21:54:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:54:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:54:52 user nova-compute[75206]: WARNING nova.compute.manager [req-e58041a9-d313-4bdc-8952-067094a7b8c7 req-b954dba4-93e9-4884-a424-2885a6ec50e5 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state active and task_state rebuilding.
Nov 29 21:54:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Port ebe76bc7-4889-4a62-8564-3a3cd230d96e binding to destination host user is already ACTIVE {{(pid=75206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d07099-7dbd-4db8-986f-b11cbad9d4e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63bc60-f937-420e-9c19-fad51d8c2eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1371ba-36ee-4fa3-97fb-b0b789d759bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfcd53-09cd-4406-8ccd-08b5d3f56c02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:54:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:54:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32fa2f-8b77-4785-bca4-cdf15735d88e]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:54:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:54:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance destroyed successfully.
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-ServerActionsTestOtherA-server-259662229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3b1902e-6a, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa530fc-9df4-4285-9133-633f83820bb5) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:03 user nova-compute[75206]: INFO os_vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a')
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e201827b-d15e-46bb-87e0-8d6e70bc5fec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:55:03 user nova-compute[75206]: No targets found.
Nov 29 21:55:03 user nova-compute[75206]: iSNS:
Nov 29 21:55:03 user nova-compute[75206]: No targets found.
Nov 29 21:55:03 user nova-compute[75206]: STATIC:
Nov 29 21:55:03 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:55:03 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:03 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:03 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:55:03 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:03 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:03 user nova-compute[75206]: FIRMWARE:
Nov 29 21:55:03 user nova-compute[75206]: No targets found.
Nov 29 21:55:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:55:03 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:55:03 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[230a00ef-4b05-403b-86a7-9cc109ab9edf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1ec16d-87b5-47f8-936b-196592f3033a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:03 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:03 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8163640>, {}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Disconnecting from: [] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== disconnect_volume: return (76ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:55:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Deleting instance files /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24_del
Nov 29 21:55:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Deletion of /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24_del complete
Nov 29 21:55:03 user nova-compute[75206]: INFO nova.virt.block_device [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Booting with volume 7cebc9d1-065e-4582-97cc-992a86558855 at /dev/vdb
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e6091-4969-4c5e-9754-624f230665f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: INFO nova.compute.manager [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Rescuing
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c2ea2-47a0-43d0-8462-6965eda746eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c2fc5-e270-49ff-a6c2-41256eb12868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3664258-9cc1-43d6-9330-8537f4e98ec8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:55:03 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:55:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8e82aa-4b7d-4554-8a34-a3c8e4c3f6fa]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:03 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating existing volume attachment record: 9284bdc6-352a-4325-bc6c-50319d79289e {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:04 user nova-compute[75206]: WARNING nova.compute.manager [req-8e1ef046-1fa7-475c-992d-c7663a196675 req-53b0e6d7-6648-48e2-99a3-c0bd11455746 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance destroyed successfully.
Nov 29 21:55:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Attempting a stable device rescue
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 21:55:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Creating image(s)
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.images [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] 3a63f76c-054c-4388-9e8d-7593ee9063da was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.part /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.part /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.converted" returned: 0 in 0.240s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: INFO nova.compute.manager [None req-6f5ce791-538b-4fd6-82a1-06350152f98e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Get console output
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:06 user nova-compute[75206]: WARNING nova.compute.manager [req-70753601-1497-444a-aa3e-9b3f100d89b3 req-50638e81-3392-4fea-a8e5-f056799a6ce4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Events pending at deletion: volume-reimaged-28e66982-2444-45e3-bd55-0bd94990ca4a {{(pid=75206) _delete_instance /opt/stack/nova/nova/compute/manager.py:3257}}
Nov 29 21:55:06 user nova-compute[75206]: INFO nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Terminating instance
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] During wait destroy, instance disappeared. {{(pid=75206) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 29 21:55:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Instance destroyed successfully.
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lazy-loading 'resources' on Instance uuid d402a442-7a9d-4b60-9ce5-413fd24e23e8 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-857059322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-897035615',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WI3fjxWugO36zCSvx0fH2n1R2EF5FiZN3G8z52zchTJcg0FZr+UGAJWwpPUanLyG4gdQkSvk5dY3kjKQ1KUX1a7KkGFsUPHB1isvelw1uIK0h1IJnNo/oy/bf+5LRXw==',key_name='tempest-keypair-1248799511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='7ca012700c6b4badb992b35e8a80ca0c',ramdisk_id='',reservation_id='r-1j46pyxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-323563625',owner_user_name='tempest-ServerActionsV293TestJSON-323563625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf037e0205444fdb984ea545d1e323ce',uuid=d402a442-7a9d-4b60-9ce5-413fd24e23e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converting VIF {"id": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "address": "fa:16:3e:44:6f:cf", "network": {"id": "e72fc775-e326-44ca-b1bb-3f421f060923", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-135021468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca012700c6b4badb992b35e8a80ca0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a603d4-d8", "ovs_interfaceid": "e1a603d4-d84b-4f30-8419-1c72d68dc14c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_vif [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a603d4-d8, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:55:06 user nova-compute[75206]: INFO os_vif [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:6f:cf,bridge_name='br-int',has_traffic_filtering=True,id=e1a603d4-d84b-4f30-8419-1c72d68dc14c,network=Network(e72fc775-e326-44ca-b1bb-3f421f060923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a603d4-d8')
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjRlHIFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a,backing_fmt=raw /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7647a0-254a-4c6d-b7e0-cae0b66b3d4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:55:06 user nova-compute[75206]: No targets found.
Nov 29 21:55:06 user nova-compute[75206]: iSNS:
Nov 29 21:55:06 user nova-compute[75206]: No targets found.
Nov 29 21:55:06 user nova-compute[75206]: STATIC:
Nov 29 21:55:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:55:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:55:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:06 user nova-compute[75206]: FIRMWARE:
Nov 29 21:55:06 user nova-compute[75206]: No targets found.
Nov 29 21:55:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:55:06 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:55:06 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e66982-2444-45e3-bd55-0bd94990ca4a', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a,backing_fmt=raw /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue" returned: 0 in 0.057s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "729b36eaec06c3e58d053dd52ed3bcfc85f1e85a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'migration_context' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6699f-f2c8-4ba7-9d94-0a43774f4d8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<d3083fb2-1acb-4cef-9ca0-061c1b1ab540> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start _get_guest_xml network_info=[{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:c5:9e:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3a63f76c-054c-4388-9e8d-7593ee9063da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5da19311-4f20-490d-acb6-286d866fe9d5', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd3083fb2-1acb-4cef-9ca0-061c1b1ab540', 'attached_at': '', 'detached_at': '', 'volume_id': '2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'serial': '2ccb91f2-1228-4db3-9d7f-02e79744c4f0'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<d3083fb2-1acb-4cef-9ca0-061c1b1ab540> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'numa_topology' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717bb6d-7468-41f3-bd3d-c025d8086314]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:06 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:06 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8464280>, {}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Disconnecting from: [] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.131s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] <== disconnect_volume: return (132ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:55:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Deletion of /opt/stack/data/nova/instances/d402a442-7a9d-4b60-9ce5-413fd24e23e8_del complete
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<d3083fb2-1acb-4cef-9ca0-061c1b1ab540> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<d3083fb2-1acb-4cef-9ca0-061c1b1ab540> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:06 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:06 user nova-compute[75206]: INFO nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Took 0.29 seconds to destroy the instance on the hypervisor.
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74556e17-077b-4a0c-9fd1-274f64412fda]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kpRKyjYE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 21:55:06 user nova-compute[75206]: node.name = iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:55:06 user nova-compute[75206]: node.tpgt = -1
Nov 29 21:55:06 user nova-compute[75206]: node.startup = automatic
Nov 29 21:55:06 user nova-compute[75206]: node.leading_login = No
Nov 29 21:55:06 user nova-compute[75206]: iface.iscsi_ifacename = default
Nov 29 21:55:06 user nova-compute[75206]: iface.net_ifacename = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.ipaddress = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.prefix_len = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.hwaddress = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.transport_name = tcp
Nov 29 21:55:06 user nova-compute[75206]: iface.initiatorname = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.vlan_id = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.vlan_priority = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.vlan_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.iface_num = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.mtu = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.port = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.bootproto = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.subnet_mask = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.gateway = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_alt_client_id = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_dns = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_learn_iqn = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_vendor_id_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_vendor_id = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.dhcp_slp_da = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.fragmentation = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.gratuitous_arp = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.incoming_forwarding = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.tos_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.tos = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.ttl = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.delayed_ack = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.tcp_nagle = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.tcp_wsf_state = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.tcp_wsf = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.tcp_timer_scale = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.tcp_timestamp = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.redirect = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.def_task_mgmt_timeout = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.header_digest = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.data_digest = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.immediate_data = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.initial_r2t = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.data_seq_inorder = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.data_pdu_inorder = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.erl = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.max_receive_data_len = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.first_burst_len = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.max_outstanding_r2t = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.max_burst_len = 0
Nov 29 21:55:06 user nova-compute[75206]: iface.chap_auth = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.bidi_chap = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.strict_login_compliance = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.discovery_auth = <empty>
Nov 29 21:55:06 user nova-compute[75206]: iface.discovery_logout = <empty>
Nov 29 21:55:06 user nova-compute[75206]: node.discovery_address = <empty>
Nov 29 21:55:06 user nova-compute[75206]: node.discovery_port = 0
Nov 29 21:55:06 user nova-compute[75206]: node.discovery_type = static
Nov 29 21:55:06 user nova-compute[75206]: node.session.initial_cmdsn = 0
Nov 29 21:55:06 user nova-compute[75206]: node.session.initial_login_retry_max = 8
Nov 29 21:55:06 user nova-compute[75206]: node.session.xmit_thread_priority = -20
Nov 29 21:55:06 user nova-compute[75206]: node.session.cmds_max = 128
Nov 29 21:55:06 user nova-compute[75206]: node.session.queue_depth = 32
Nov 29 21:55:06 user nova-compute[75206]: node.session.nr_sessions = 1
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.authmethod = CHAP
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.username = kpRKyjYE
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.password = ***
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.username_in = <empty>
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.password_in = <empty>
Nov 29 21:55:06 user nova-compute[75206]: node.session.auth.chap_algs = MD5
Nov 29 21:55:06 user nova-compute[75206]: node.session.timeo.replacement_timeout = 120
Nov 29 21:55:06 user nova-compute[75206]: node.session.err_timeo.abort_timeout = 15
Nov 29 21:55:06 user nova-compute[75206]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 21:55:06 user nova-compute[75206]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 21:55:06 user nova-compute[75206]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.FastAbort = Yes
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.InitialR2T = No
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.ImmediateData = Yes
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.MaxConnections = 1
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 21:55:06 user nova-compute[75206]: node.session.iscsi.ERL = 0
Nov 29 21:55:06 user nova-compute[75206]: node.session.scan = manual
Nov 29 21:55:06 user nova-compute[75206]: node.session.reopen_max = 0
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].address = 172.16.0.220
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].port = 3260
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].startup = manual
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].tcp.window_size = 524288
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].tcp.type_of_service = 0
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].timeo.logout_timeout = 15
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].timeo.login_timeout = 15
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].timeo.auth_timeout = 45
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.DataDigest = None
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.IFMarker = No
Nov 29 21:55:06 user nova-compute[75206]: node.conn[0].iscsi.OFMarker = No
Nov 29 21:55:06 user nova-compute[75206]: # END RECORD
Nov 29 21:55:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba73080-cd92-454d-bb96-4ea075e527c2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa83194-a347-475e-af71-f9a0ad18f916]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpRKyjYE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpRKyjYE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d9c0e-a52f-4939-9c55-bff5ecfd5a54]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpRKyjYE'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f2281-c958-4f69-80f1-c109311543fc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c136699-7da5-4192-a57a-f3b1a73e7827]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:07 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:07 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] HCTL ('34', '0', '0', 0) found on session 20 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8be42-4f08-41df-8c16-dcd79f2bdb69]: (4, ('0 0 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching for a device in session 20 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23437633961363664', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633961363664', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413138911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413138911',id=27,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-01h1cyi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:26Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=d3083fb2-1acb-4cef-9ca0-061c1b1ab540,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:c5:9e:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:c5:9e:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.objects.base [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<d3083fb2-1acb-4cef-9ca0-061c1b1ab540> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:07 user nova-compute[75206]:   <uuid>d3083fb2-1acb-4cef-9ca0-061c1b1ab540</uuid>
Nov 29 21:55:07 user nova-compute[75206]:   <name>instance-0000001b</name>
Nov 29 21:55:07 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:55:07 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:07 user nova-compute[75206]:   <metadata>
Nov 29 21:55:07 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:07 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-413138911</nova:name>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:06</nova:creationTime>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:55:07 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:07 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 21:55:07 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:07 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:07 user nova-compute[75206]:         <nova:port uuid="ad25aa03-da97-4b67-92c6-ffe789c5f726">
Nov 29 21:55:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 21:55:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:07 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:07 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:07 user nova-compute[75206]:   </metadata>
Nov 29 21:55:07 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:07 user nova-compute[75206]:     <system>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="serial">d3083fb2-1acb-4cef-9ca0-061c1b1ab540</entry>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="uuid">d3083fb2-1acb-4cef-9ca0-061c1b1ab540</entry>
Nov 29 21:55:07 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:07 user nova-compute[75206]:     </system>
Nov 29 21:55:07 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:07 user nova-compute[75206]:   <os>
Nov 29 21:55:07 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:07 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:07 user nova-compute[75206]:   </os>
Nov 29 21:55:07 user nova-compute[75206]:   <features>
Nov 29 21:55:07 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:07 user nova-compute[75206]:     <apic/>
Nov 29 21:55:07 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:07 user nova-compute[75206]:   </features>
Nov 29 21:55:07 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:07 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:07 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:07 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:07 user nova-compute[75206]:   </clock>
Nov 29 21:55:07 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:07 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:07 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:07 user nova-compute[75206]:   </cpu>
Nov 29 21:55:07 user nova-compute[75206]:   <devices>
Nov 29 21:55:07 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:55:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:07 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 21:55:07 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:07 user nova-compute[75206]:       <serial>2ccb91f2-1228-4db3-9d7f-02e79744c4f0</serial>
Nov 29 21:55:07 user nova-compute[75206]:     </disk>
Nov 29 21:55:07 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:07 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:07 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue"/>
Nov 29 21:55:07 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:55:07 user nova-compute[75206]:       <boot order="1"/>
Nov 29 21:55:07 user nova-compute[75206]:     </disk>
Nov 29 21:55:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:07 user nova-compute[75206]:       <mac address="fa:16:3e:c5:9e:15"/>
Nov 29 21:55:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:07 user nova-compute[75206]:       <target dev="tapad25aa03-da"/>
Nov 29 21:55:07 user nova-compute[75206]:     </interface>
Nov 29 21:55:07 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:07 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/console.log" append="off"/>
Nov 29 21:55:07 user nova-compute[75206]:     </serial>
Nov 29 21:55:07 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:07 user nova-compute[75206]:     <video>
Nov 29 21:55:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:07 user nova-compute[75206]:     </video>
Nov 29 21:55:07 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:07 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:07 user nova-compute[75206]:     </rng>
Nov 29 21:55:07 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:07 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:07 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:07 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:07 user nova-compute[75206]:   </devices>
Nov 29 21:55:07 user nova-compute[75206]: </domain>
Nov 29 21:55:07 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance destroyed successfully.
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:c5:9e:15, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:07 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Took 0.66 seconds to deallocate network for instance.
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-ac049e25-898d-4ef5-bdf6-775c89ede52e req-6011b35e-9bae-4d80-9fdf-105734f2a300 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Received event network-vif-deleted-e1a603d4-d84b-4f30-8419-1c72d68dc14c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:07 user nova-compute[75206]: INFO nova.compute.manager [req-ac049e25-898d-4ef5-bdf6-775c89ede52e req-6011b35e-9bae-4d80-9fdf-105734f2a300 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Neutron deleted interface e1a603d4-d84b-4f30-8419-1c72d68dc14c; detaching it from the instance and deleting it from the info cache
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.network.neutron [req-ac049e25-898d-4ef5-bdf6-775c89ede52e req-6011b35e-9bae-4d80-9fdf-105734f2a300 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-ac049e25-898d-4ef5-bdf6-775c89ede52e req-6011b35e-9bae-4d80-9fdf-105734f2a300 service nova] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Detach interface failed, port_id=e1a603d4-d84b-4f30-8419-1c72d68dc14c, reason: Instance d402a442-7a9d-4b60-9ce5-413fd24e23e8 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:08 user nova-compute[75206]: WARNING nova.compute.manager [req-350c080b-1444-4987-9316-8abe9a1a1b3e req-46629fc9-7137-4a12-b581-de79eacd7d58 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:09 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f603593a-9ed6-4750-be67-8004112c5093 is timed out.
Nov 29 21:55:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance f603593a-9ed6-4750-be67-8004112c5093 from the live domain config.
Nov 29 21:55:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXefPcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:09 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770edde-2a4e-431b-8255-2ba2d1995c8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:55:09 user nova-compute[75206]: No targets found.
Nov 29 21:55:09 user nova-compute[75206]: iSNS:
Nov 29 21:55:09 user nova-compute[75206]: No targets found.
Nov 29 21:55:09 user nova-compute[75206]: STATIC:
Nov 29 21:55:09 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:55:09 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:09 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:09 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411
Nov 29 21:55:09 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:55:09 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:55:09 user nova-compute[75206]: FIRMWARE:
Nov 29 21:55:09 user nova-compute[75206]: No targets found.
Nov 29 21:55:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:55:09 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:55:09 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5db74-b858-49d7-a101-5f05954be91a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[028873af-7d08-477f-a65e-630a351245ef]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:09 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:09 user nova-compute[75206]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 (non-flash)
Nov 29 21:55:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81ed6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dade08-ccb0-4792-827e-8de0c40a83ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f86877-9227-49d8-bb96-2e008c48aaf8]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[70931e04-93f7-4a72-87bf-bef67dcb2ae1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26eba3d-5d85-4253-ba5b-d50e197a511c]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d2172d-80f4-48d4-8378-4335481883e7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b5004e-9800-4df5-b143-14e80949759a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260]
Nov 29 21:55:09 user nova-compute[75206]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411, portal: 172.16.0.220,3260] successful.
Nov 29 21:55:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd783eb7-80c5-4fd4-90d6-e5646ec04411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96427b0-b6d0-42fb-bf8f-2f1120dbb0af]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== disconnect_volume: return (293ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cb859f97-f17c-4e27-b742-9d38a4a7bdd8 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:10 user nova-compute[75206]: WARNING nova.compute.manager [req-91c52f1f-b4ce-4b02-aaea-bce0c98ab74f req-f4ae4dcc-8663-486c-9d85-7332cc5e7bc6 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state rescued and task_state None.
Nov 29 21:55:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:14 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:14 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:14 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a095e36-548e-4ee2-8e12-2db98d2ad04e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:55:14 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2ff46-5d12-41c6-ae33-5907dc7ca342]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552] added
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99771a04-f4b7-48fb-9491-83507777e2ba]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc1347-1e5a-4721-b8c7-3a69592b169c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqCGAHEM {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqCGAHEM" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b9d0c-fc8a-4832-8e3e-47ce5c35c873]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqCGAHEM'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: INFO nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Took 6.57 seconds to detach 1 volumes for instance.
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007c36f-3faf-4681-8f4d-26a70e65462f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] [instance: d402a442-7a9d-4b60-9ce5-413fd24e23e8] Deleting volume: 28e66982-2444-45e3-bd55-0bd94990ca4a {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b35165-4284-4edc-9693-e0ea6f05695d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa7249f-f8a3-477f-bfbb-7874d96d68bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260]
Nov 29 21:55:14 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260] successful.
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ac1d7-ce22-4988-bd8d-2bdf7cd61fa0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9790a2-8c83-459e-96ca-1e6877d7f2e4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f576f79a-3afc-463b-b3dc-18fe2754d9e9]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26165363236646164', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165363236646164', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'flavor' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:55:15 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:15 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:55:15 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:55:15 user nova-compute[75206]:   <serial>93ded810-c10f-48a3-9277-ed738d710552</serial>
Nov 29 21:55:15 user nova-compute[75206]: </disk>
Nov 29 21:55:15 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No VIF found with MAC fa:16:3e:91:f9:e4, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f6d30a8a-a54d-496e-b183-fcc3d481e8a8 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.161s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0ecd8f2b-cb93-40b9-a0da-1fdb27e2074c tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.405s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Starting finish_migration {{(pid=75206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 21:55:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 21:55:19 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Creating image(s)
Nov 29 21:55:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:55:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Creating image(s)
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.301s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk. size=21474836480 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk 21474836480 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk 21474836480" returned: 0 in 0.048s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Ensure instance console log exists: /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start _get_guest_xml network_info=[{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '6b251710-b674-43dc-bf4b-0a1a5e6e9ad1', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1d5f34b2-1301-4d46-9183-55c070ba28d5', 'attached_at': '2023-11-29T21:55:20.000000', 'detached_at': '', 'volume_id': 'fd1ecab4-3282-4065-b907-c3d5ab205bff', 'serial': 'fd1ecab4-3282-4065-b907-c3d5ab205bff'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:20 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:20 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:20 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:20 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:20 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.232s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d36638-cc7d-4634-a1e1-cdd331bb49bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:55:20 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk 1073741824" returned: 0 in 0.055s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd69be-194c-4e40-bfd6-01a4e29999e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added
Nov 29 21:55:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d175f-5234-437c-b796-a88f0ec5473b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eefce88-074f-4494-8adb-6f63ae898c37]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55cfc2b-bc61-4d6f-8911-6e38a127ae27]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNCtFRvT'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.950s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa3af76-881b-41f5-8adf-74d4316bc94a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Deleted allocations for instance d402a442-7a9d-4b60-9ce5-413fd24e23e8
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87fbd8-3e91-4111-bdd1-a4c04df00daa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:20 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:20 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.218s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:55:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b977552-19ec-456a-a47f-8604ff802c0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:55:21 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:55:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51a78f7-e648-4673-bbeb-de2b2f823571]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf19194-ff82-404b-9d04-a8cb460e5877]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:21 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:21 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:21 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:21 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-445147c7-b179-4681-b405-66c7e911de3e tempest-ServerActionsV293TestJSON-323563625 tempest-ServerActionsV293TestJSON-323563625-project-member] Lock "d402a442-7a9d-4b60-9ce5-413fd24e23e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.433s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fafd88-125e-4807-af9b-89d391ed97d3]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Cannot resize image /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Ensure instance console log exists: /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start _get_guest_xml network_info=[{"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '9284bdc6-352a-4325-bc6c-50319d79289e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39f1132e-912d-455d-8686-6bdaf870da24', 'attached_at': '', 'detached_at': '', 'volume_id': '7cebc9d1-065e-4582-97cc-992a86558855', 'serial': '7cebc9d1-065e-4582-97cc-992a86558855'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:21 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 21:55:21 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.objects.instance [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:21 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:55:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:21 user nova-compute[75206]: INFO nova.compute.manager [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Rescuing
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:21 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.871s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:22 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:22 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5b53b-57c1-49db-904f-525a3e677235]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:55:22 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:22 user nova-compute[75206]:   <uuid>1d5f34b2-1301-4d46-9183-55c070ba28d5</uuid>
Nov 29 21:55:22 user nova-compute[75206]:   <name>instance-00000015</name>
Nov 29 21:55:22 user nova-compute[75206]:   <memory>2097152</memory>
Nov 29 21:55:22 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:22 user nova-compute[75206]:   <metadata>
Nov 29 21:55:22 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:22 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1888886025</nova:name>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:20</nova:creationTime>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:flavor name="m1.small">
Nov 29 21:55:22 user nova-compute[75206]:         <nova:memory>2048</nova:memory>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:disk>20</nova:disk>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:22 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:user uuid="e37b628d0f0a460aa528e4185c4b6683">tempest-ServerActionsTestOtherB-957997184-project-member</nova:user>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:project uuid="44f2c15727dc47e19d00ff536db432df">tempest-ServerActionsTestOtherB-957997184</nova:project>
Nov 29 21:55:22 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:22 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:22 user nova-compute[75206]:         <nova:port uuid="ebe76bc7-4889-4a62-8564-3a3cd230d96e">
Nov 29 21:55:22 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:55:22 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:22 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:22 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:22 user nova-compute[75206]:   </metadata>
Nov 29 21:55:22 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:22 user nova-compute[75206]:     <system>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="serial">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="uuid">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:55:22 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:22 user nova-compute[75206]:     </system>
Nov 29 21:55:22 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:22 user nova-compute[75206]:   <os>
Nov 29 21:55:22 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:22 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:55:22 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:22 user nova-compute[75206]:   </os>
Nov 29 21:55:22 user nova-compute[75206]:   <features>
Nov 29 21:55:22 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:22 user nova-compute[75206]:     <apic/>
Nov 29 21:55:22 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:22 user nova-compute[75206]:   </features>
Nov 29 21:55:22 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:22 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:22 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:22 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:22 user nova-compute[75206]:   </clock>
Nov 29 21:55:22 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:22 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:22 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:22 user nova-compute[75206]:   </cpu>
Nov 29 21:55:22 user nova-compute[75206]:   <devices>
Nov 29 21:55:22 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:22 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:22 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk"/>
Nov 29 21:55:22 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:22 user nova-compute[75206]:     </disk>
Nov 29 21:55:22 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:55:22 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:22 user nova-compute[75206]:       <source dev="/dev/sdd"/>
Nov 29 21:55:22 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:55:22 user nova-compute[75206]:       <serial>fd1ecab4-3282-4065-b907-c3d5ab205bff</serial>
Nov 29 21:55:22 user nova-compute[75206]:     </disk>
Nov 29 21:55:22 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:22 user nova-compute[75206]:       <mac address="fa:16:3e:2d:f2:ae"/>
Nov 29 21:55:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:22 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:22 user nova-compute[75206]:       <target dev="tapebe76bc7-48"/>
Nov 29 21:55:22 user nova-compute[75206]:     </interface>
Nov 29 21:55:22 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:22 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/console.log" append="off"/>
Nov 29 21:55:22 user nova-compute[75206]:     </serial>
Nov 29 21:55:22 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:22 user nova-compute[75206]:     <video>
Nov 29 21:55:22 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:22 user nova-compute[75206]:     </video>
Nov 29 21:55:22 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:22 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:22 user nova-compute[75206]:     </rng>
Nov 29 21:55:22 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:22 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:22 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:22 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:22 user nova-compute[75206]:   </devices>
Nov 29 21:55:22 user nova-compute[75206]: </domain>
Nov 29 21:55:22 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2127429818-network", "vif_mac": "fa:16:3e:2d:f2:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b45c3ed-b673-565d-b75a-4cfc9bf8212f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36aede-0c5d-4d2b-9d0e-fa6b0e13088b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855] added
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebe76bc7-48, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebe76bc7-48, col_values=(('qos', UUID('be007be6-4363-42e4-b5be-3d0730b9f8f9')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebe76bc7-48, col_values=(('external_ids', {'iface-id': 'ebe76bc7-4889-4a62-8564-3a3cd230d96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:ae', 'vm-uuid': '1d5f34b2-1301-4d46-9183-55c070ba28d5'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: INFO os_vif [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd09336-da60-4634-9c59-5acefaaceaa4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdee320-f9f3-4f5d-85f5-cb159e866b66]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGEnlbiR {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kGEnlbiR" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[111486a7-2f12-4c18-a278-dac5cdae5fb4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kGEnlbiR'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] No VIF found with MAC fa:16:3e:2d:f2:ae, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[834034f8-134f-4ff9-84df-a8bb9e654594]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fd420-9502-4de7-a637-19f4c689dd7d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ac14f-ae48-45d2-b5ef-4cc091c560b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]
Nov 29 21:55:22 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57413a1-c9e6-432f-bdae-8e717f4fb78b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d61adf-f896-4004-a1ea-33149edd7cd1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:22 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e050c5-fd9f-4169-9d3b-5daea0edf76c]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:22 user nova-compute[75206]: WARNING nova.compute.manager [req-22a56803-80d9-43bb-8078-c02afffae3ee req-6856b56a-4518-4044-add6-aca2c25bac54 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== connect_volume: return (2289ms) {'type': 'block', 'scsi_wwn': '23765323337326233', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323337326233', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-ServerActionsTestOtherA-server-259662229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:23 user nova-compute[75206]:   <uuid>39f1132e-912d-455d-8686-6bdaf870da24</uuid>
Nov 29 21:55:23 user nova-compute[75206]:   <name>instance-0000001a</name>
Nov 29 21:55:23 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:55:23 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:23 user nova-compute[75206]:   <metadata>
Nov 29 21:55:23 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:23 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherA-server-259662229</nova:name>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:21</nova:creationTime>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:55:23 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:23 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:user uuid="656a5b2470e14813b3060d41b1d61095">tempest-ServerActionsTestOtherA-2043072317-project-member</nova:user>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:project uuid="feaa0640f6b84a71b856782e45ca4adf">tempest-ServerActionsTestOtherA-2043072317</nova:project>
Nov 29 21:55:23 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:23 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:23 user nova-compute[75206]:         <nova:port uuid="a3b1902e-6a42-4849-8d5c-0567d9601b8f">
Nov 29 21:55:23 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 21:55:23 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:23 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:23 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:23 user nova-compute[75206]:   </metadata>
Nov 29 21:55:23 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:23 user nova-compute[75206]:     <system>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="serial">39f1132e-912d-455d-8686-6bdaf870da24</entry>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="uuid">39f1132e-912d-455d-8686-6bdaf870da24</entry>
Nov 29 21:55:23 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:23 user nova-compute[75206]:     </system>
Nov 29 21:55:23 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:23 user nova-compute[75206]:   <os>
Nov 29 21:55:23 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:23 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:55:23 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:23 user nova-compute[75206]:   </os>
Nov 29 21:55:23 user nova-compute[75206]:   <features>
Nov 29 21:55:23 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:23 user nova-compute[75206]:     <apic/>
Nov 29 21:55:23 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:23 user nova-compute[75206]:   </features>
Nov 29 21:55:23 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:23 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:23 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:23 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:23 user nova-compute[75206]:   </clock>
Nov 29 21:55:23 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:23 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:23 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:23 user nova-compute[75206]:   </cpu>
Nov 29 21:55:23 user nova-compute[75206]:   <devices>
Nov 29 21:55:23 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:23 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:23 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk"/>
Nov 29 21:55:23 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:23 user nova-compute[75206]:     </disk>
Nov 29 21:55:23 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:55:23 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:23 user nova-compute[75206]:       <source dev="/dev/sde"/>
Nov 29 21:55:23 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:55:23 user nova-compute[75206]:       <serial>7cebc9d1-065e-4582-97cc-992a86558855</serial>
Nov 29 21:55:23 user nova-compute[75206]:     </disk>
Nov 29 21:55:23 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:23 user nova-compute[75206]:       <mac address="fa:16:3e:6d:10:cd"/>
Nov 29 21:55:23 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:23 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:23 user nova-compute[75206]:       <target dev="tapa3b1902e-6a"/>
Nov 29 21:55:23 user nova-compute[75206]:     </interface>
Nov 29 21:55:23 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:23 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/console.log" append="off"/>
Nov 29 21:55:23 user nova-compute[75206]:     </serial>
Nov 29 21:55:23 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:23 user nova-compute[75206]:     <video>
Nov 29 21:55:23 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:23 user nova-compute[75206]:     </video>
Nov 29 21:55:23 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:23 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:23 user nova-compute[75206]:     </rng>
Nov 29 21:55:23 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:23 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:23 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:23 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:23 user nova-compute[75206]:   </devices>
Nov 29 21:55:23 user nova-compute[75206]: </domain>
Nov 29 21:55:23 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-ServerActionsTestOtherA-server-259662229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG os_vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8203b0-c8a1-5394-b06f-90ca1ca14784', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3b1902e-6a, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3b1902e-6a, col_values=(('qos', UUID('98d802d7-1974-4a2d-aa48-f3937e9691ef')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3b1902e-6a, col_values=(('external_ids', {'iface-id': 'a3b1902e-6a42-4849-8d5c-0567d9601b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:10:cd', 'vm-uuid': '39f1132e-912d-455d-8686-6bdaf870da24'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: INFO os_vif [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a')
Nov 29 21:55:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:6d:10:cd, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance destroyed successfully.
Nov 29 21:55:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attempting a stable device rescue
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 21:55:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Creating image(s)
Nov 29 21:55:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "78ac238f0dbaeea9032334f6033749273481fe9e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "78ac238f0dbaeea9032334f6033749273481fe9e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:24 user nova-compute[75206]: WARNING nova.compute.manager [req-48450b5f-bc1d-4ac4-9f32-81e80b9be605 req-45ae7d0a-4fed-4363-9743-b930d0214f93 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state active and task_state resize_finish.
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:55:24 user nova-compute[75206]: INFO nova.compute.manager [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Rescuing
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:24 user nova-compute[75206]: WARNING nova.compute.manager [req-b17a27e8-8a24-490d-b969-82e8ae16b990 req-e3d9f64f-358c-4ccc-baf8-16210e9887e3 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.virt.images [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] f58e6c38-e7d1-49e4-9aa0-ada8fd5cbdf4 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.part /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.part /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.converted" returned: 0 in 0.309s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "78ac238f0dbaeea9032334f6033749273481fe9e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "78ac238f0dbaeea9032334f6033749273481fe9e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "78ac238f0dbaeea9032334f6033749273481fe9e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e,backing_fmt=raw /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e,backing_fmt=raw /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue" returned: 0 in 0.060s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "78ac238f0dbaeea9032334f6033749273481fe9e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'migration_context' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Object Instance<a0f802b4-01a1-4f73-9045-2c775637d75d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start _get_guest_xml network_info=[{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "vif_mac": "fa:16:3e:91:f9:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f58e6c38-e7d1-49e4-9aa0-ada8fd5cbdf4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '8a0e4eb5-d3a5-4be7-bc40-4e8eb13f6e58', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a0f802b4-01a1-4f73-9045-2c775637d75d', 'attached_at': '', 'detached_at': '', 'volume_id': '93ded810-c10f-48a3-9277-ed738d710552', 'serial': '93ded810-c10f-48a3-9277-ed738d710552'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'resources' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Object Instance<a0f802b4-01a1-4f73-9045-2c775637d75d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'numa_topology' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Object Instance<a0f802b4-01a1-4f73-9045-2c775637d75d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.objects.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Object Instance<a0f802b4-01a1-4f73-9045-2c775637d75d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:25 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:25 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:25 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e0d9d4-9cce-4641-bbc4-c6f9a9786122]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pqCGAHEM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 21:55:25 user nova-compute[75206]: node.name = iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:55:25 user nova-compute[75206]: node.tpgt = -1
Nov 29 21:55:25 user nova-compute[75206]: node.startup = automatic
Nov 29 21:55:25 user nova-compute[75206]: node.leading_login = No
Nov 29 21:55:25 user nova-compute[75206]: iface.iscsi_ifacename = default
Nov 29 21:55:25 user nova-compute[75206]: iface.net_ifacename = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.ipaddress = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.prefix_len = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.hwaddress = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.transport_name = tcp
Nov 29 21:55:25 user nova-compute[75206]: iface.initiatorname = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.vlan_id = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.vlan_priority = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.vlan_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.iface_num = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.mtu = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.port = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.bootproto = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.subnet_mask = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.gateway = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_alt_client_id = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_dns = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_learn_iqn = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_vendor_id_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_vendor_id = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.dhcp_slp_da = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.fragmentation = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.gratuitous_arp = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.incoming_forwarding = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.tos_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.tos = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.ttl = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.delayed_ack = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.tcp_nagle = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.tcp_wsf_state = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.tcp_wsf = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.tcp_timer_scale = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.tcp_timestamp = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.redirect = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.def_task_mgmt_timeout = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.header_digest = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.data_digest = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.immediate_data = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.initial_r2t = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.data_seq_inorder = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.data_pdu_inorder = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.erl = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.max_receive_data_len = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.first_burst_len = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.max_outstanding_r2t = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.max_burst_len = 0
Nov 29 21:55:25 user nova-compute[75206]: iface.chap_auth = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.bidi_chap = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.strict_login_compliance = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.discovery_auth = <empty>
Nov 29 21:55:25 user nova-compute[75206]: iface.discovery_logout = <empty>
Nov 29 21:55:25 user nova-compute[75206]: node.discovery_address = <empty>
Nov 29 21:55:25 user nova-compute[75206]: node.discovery_port = 0
Nov 29 21:55:25 user nova-compute[75206]: node.discovery_type = static
Nov 29 21:55:25 user nova-compute[75206]: node.session.initial_cmdsn = 0
Nov 29 21:55:25 user nova-compute[75206]: node.session.initial_login_retry_max = 8
Nov 29 21:55:25 user nova-compute[75206]: node.session.xmit_thread_priority = -20
Nov 29 21:55:25 user nova-compute[75206]: node.session.cmds_max = 128
Nov 29 21:55:25 user nova-compute[75206]: node.session.queue_depth = 32
Nov 29 21:55:25 user nova-compute[75206]: node.session.nr_sessions = 1
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.authmethod = CHAP
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.username = pqCGAHEM
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.password = ***
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.username_in = <empty>
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.password_in = <empty>
Nov 29 21:55:25 user nova-compute[75206]: node.session.auth.chap_algs = MD5
Nov 29 21:55:25 user nova-compute[75206]: node.session.timeo.replacement_timeout = 120
Nov 29 21:55:25 user nova-compute[75206]: node.session.err_timeo.abort_timeout = 15
Nov 29 21:55:25 user nova-compute[75206]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 21:55:25 user nova-compute[75206]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 21:55:25 user nova-compute[75206]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.FastAbort = Yes
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.InitialR2T = No
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.ImmediateData = Yes
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.MaxConnections = 1
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 21:55:25 user nova-compute[75206]: node.session.iscsi.ERL = 0
Nov 29 21:55:25 user nova-compute[75206]: node.session.scan = manual
Nov 29 21:55:25 user nova-compute[75206]: node.session.reopen_max = 0
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].address = 172.16.0.220
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].port = 3260
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].startup = manual
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].tcp.window_size = 524288
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].tcp.type_of_service = 0
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].timeo.logout_timeout = 15
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].timeo.login_timeout = 15
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].timeo.auth_timeout = 45
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.DataDigest = None
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.IFMarker = No
Nov 29 21:55:25 user nova-compute[75206]: node.conn[0].iscsi.OFMarker = No
Nov 29 21:55:25 user nova-compute[75206]: # END RECORD
Nov 29 21:55:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:25 user nova-compute[75206]: WARNING nova.compute.manager [req-826e80ca-20f2-4fdb-99bc-9104a2daf558 req-f4d02388-0cbf-4eb9-8556-f9598e098e4c service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05eb84-e51e-4549-9e68-64d402ab7e26]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6342adb2-4524-4e02-8925-7e66793ddbb1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqCGAHEM {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqCGAHEM" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[212fe1da-94ba-432a-b43d-961ceb5eadf0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqCGAHEM'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c735b6-6449-4a1d-9077-a43a8b321ed5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa61b3-0f55-4db7-a73a-a8c6e40a5b05]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:26 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:26 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.213s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] HCTL ('33', '0', '0', 0) found on session 24 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f375de8d-706e-4618-999a-2fc136c4a0eb]: (4, ('0 0 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Searching for a device in session 24 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.248s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] <== connect_volume: return (250ms) {'type': 'block', 'scsi_wwn': '26165363236646164', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165363236646164', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-244463796',display_name='tempest-ServerStableDeviceRescueTest-server-244463796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-244463796',id=22,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgDfI6cOSssiguvTUo1OxD2sn9+6FgjoVcX+pNO1J+Sce/OQuUX/V7hTKuQSrJwyg2tKN+JZWZzlLODLdoe4ORW8hXUbgBPBjXT6teOPO1JnIEn5IDb4NJqCqHLzpk+tg==',key_name='tempest-keypair-121556689',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:51:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c97bf8394f8462ab3804fff32aa78d0',ramdisk_id='',reservation_id='r-rx7wd2jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1905805476',owner_user_name='tempest-ServerStableDeviceRescueTest-1905805476-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f201d8cbf844e4b6726ce9f35ca439',uuid=a0f802b4-01a1-4f73-9045-2c775637d75d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "vif_mac": "fa:16:3e:91:f9:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converting VIF {"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "vif_mac": "fa:16:3e:91:f9:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Object Instance<a0f802b4-01a1-4f73-9045-2c775637d75d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:26 user nova-compute[75206]:   <uuid>a0f802b4-01a1-4f73-9045-2c775637d75d</uuid>
Nov 29 21:55:26 user nova-compute[75206]:   <name>instance-00000016</name>
Nov 29 21:55:26 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:55:26 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:26 user nova-compute[75206]:   <metadata>
Nov 29 21:55:26 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:26 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-244463796</nova:name>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:25</nova:creationTime>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:55:26 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:26 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:user uuid="16f201d8cbf844e4b6726ce9f35ca439">tempest-ServerStableDeviceRescueTest-1905805476-project-member</nova:user>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:project uuid="8c97bf8394f8462ab3804fff32aa78d0">tempest-ServerStableDeviceRescueTest-1905805476</nova:project>
Nov 29 21:55:26 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:26 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:26 user nova-compute[75206]:         <nova:port uuid="2d0df5d7-9c74-49f7-a2cd-dec9050dd926">
Nov 29 21:55:26 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 21:55:26 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:26 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:26 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:26 user nova-compute[75206]:   </metadata>
Nov 29 21:55:26 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:26 user nova-compute[75206]:     <system>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="serial">a0f802b4-01a1-4f73-9045-2c775637d75d</entry>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="uuid">a0f802b4-01a1-4f73-9045-2c775637d75d</entry>
Nov 29 21:55:26 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:26 user nova-compute[75206]:     </system>
Nov 29 21:55:26 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:26 user nova-compute[75206]:   <os>
Nov 29 21:55:26 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:26 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:26 user nova-compute[75206]:   </os>
Nov 29 21:55:26 user nova-compute[75206]:   <features>
Nov 29 21:55:26 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:26 user nova-compute[75206]:     <apic/>
Nov 29 21:55:26 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:26 user nova-compute[75206]:   </features>
Nov 29 21:55:26 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:26 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:26 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:26 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:26 user nova-compute[75206]:   </clock>
Nov 29 21:55:26 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:26 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:26 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:26 user nova-compute[75206]:   </cpu>
Nov 29 21:55:26 user nova-compute[75206]:   <devices>
Nov 29 21:55:26 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:26 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:26 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk"/>
Nov 29 21:55:26 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:26 user nova-compute[75206]:     </disk>
Nov 29 21:55:26 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:55:26 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:26 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 21:55:26 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:55:26 user nova-compute[75206]:       <serial>93ded810-c10f-48a3-9277-ed738d710552</serial>
Nov 29 21:55:26 user nova-compute[75206]:     </disk>
Nov 29 21:55:26 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:26 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:26 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue"/>
Nov 29 21:55:26 user nova-compute[75206]:       <target dev="vdc" bus="virtio"/>
Nov 29 21:55:26 user nova-compute[75206]:       <boot order="1"/>
Nov 29 21:55:26 user nova-compute[75206]:     </disk>
Nov 29 21:55:26 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:26 user nova-compute[75206]:       <mac address="fa:16:3e:91:f9:e4"/>
Nov 29 21:55:26 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:26 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:26 user nova-compute[75206]:       <target dev="tap2d0df5d7-9c"/>
Nov 29 21:55:26 user nova-compute[75206]:     </interface>
Nov 29 21:55:26 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:26 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/console.log" append="off"/>
Nov 29 21:55:26 user nova-compute[75206]:     </serial>
Nov 29 21:55:26 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:26 user nova-compute[75206]:     <video>
Nov 29 21:55:26 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:26 user nova-compute[75206]:     </video>
Nov 29 21:55:26 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:26 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:26 user nova-compute[75206]:     </rng>
Nov 29 21:55:26 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:26 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:26 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:26 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:26 user nova-compute[75206]:   </devices>
Nov 29 21:55:26 user nova-compute[75206]: </domain>
Nov 29 21:55:26 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance destroyed successfully.
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] No VIF found with MAC fa:16:3e:91:f9:e4, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:26 user nova-compute[75206]: WARNING nova.compute.manager [req-1ec47b5e-35f0-48a2-9dad-dedfdc612d7b req-be69cc31-9352-40e8-be47-e89a9cf77070 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state active and task_state resize_finish.
Nov 29 21:55:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:26 user nova-compute[75206]: WARNING nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:26 user nova-compute[75206]: WARNING nova.compute.manager [req-124185f2-d4db-4b70-a736-e509b7f9bae9 req-0fb10345-2ce6-47ba-b17f-cf66d2bbaba3 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state active and task_state rebuild_spawning.
Nov 29 21:55:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance destroyed successfully.
Nov 29 21:55:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Attempting rescue
Nov 29 21:55:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 21:55:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Creating image(s)
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue" returned: 0 in 0.059s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'migration_context' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.base [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<6911f6f7-402e-4e43-9b0f-97cc3fd73f9e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start _get_guest_xml network_info=[{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:d7:5e:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.base [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<6911f6f7-402e-4e43-9b0f-97cc3fd73f9e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'numa_topology' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.base [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<6911f6f7-402e-4e43-9b0f-97cc3fd73f9e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:27 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:27 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.base [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<6911f6f7-402e-4e43-9b0f-97cc3fd73f9e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1534183753',display_name='tempest-ServerRescueNegativeTestJSON-server-1534183753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1534183753',id=19,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-18urr8hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:50:48Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=6911f6f7-402e-4e43-9b0f-97cc3fd73f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:d7:5e:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:d7:5e:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.objects.base [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<6911f6f7-402e-4e43-9b0f-97cc3fd73f9e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:27 user nova-compute[75206]:   <uuid>6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</uuid>
Nov 29 21:55:27 user nova-compute[75206]:   <name>instance-00000013</name>
Nov 29 21:55:27 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:55:27 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:27 user nova-compute[75206]:   <metadata>
Nov 29 21:55:27 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:27 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1534183753</nova:name>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:27</nova:creationTime>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:55:27 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:27 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 21:55:27 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:27 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:27 user nova-compute[75206]:         <nova:port uuid="21862692-e750-499a-8a72-0ec3b9498c14">
Nov 29 21:55:27 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 21:55:27 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:27 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:27 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:27 user nova-compute[75206]:   </metadata>
Nov 29 21:55:27 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:27 user nova-compute[75206]:     <system>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="serial">6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</entry>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="uuid">6911f6f7-402e-4e43-9b0f-97cc3fd73f9e</entry>
Nov 29 21:55:27 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:27 user nova-compute[75206]:     </system>
Nov 29 21:55:27 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:27 user nova-compute[75206]:   <os>
Nov 29 21:55:27 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:27 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:27 user nova-compute[75206]:   </os>
Nov 29 21:55:27 user nova-compute[75206]:   <features>
Nov 29 21:55:27 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:27 user nova-compute[75206]:     <apic/>
Nov 29 21:55:27 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:27 user nova-compute[75206]:   </features>
Nov 29 21:55:27 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:27 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:27 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:27 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:27 user nova-compute[75206]:   </clock>
Nov 29 21:55:27 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:27 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:27 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:27 user nova-compute[75206]:   </cpu>
Nov 29 21:55:27 user nova-compute[75206]:   <devices>
Nov 29 21:55:27 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:27 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:27 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue"/>
Nov 29 21:55:27 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:27 user nova-compute[75206]:     </disk>
Nov 29 21:55:27 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:27 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:27 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk"/>
Nov 29 21:55:27 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:55:27 user nova-compute[75206]:     </disk>
Nov 29 21:55:27 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:27 user nova-compute[75206]:       <mac address="fa:16:3e:d7:5e:10"/>
Nov 29 21:55:27 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:27 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:27 user nova-compute[75206]:       <target dev="tap21862692-e7"/>
Nov 29 21:55:27 user nova-compute[75206]:     </interface>
Nov 29 21:55:27 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:27 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/console.log" append="off"/>
Nov 29 21:55:27 user nova-compute[75206]:     </serial>
Nov 29 21:55:27 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:27 user nova-compute[75206]:     <video>
Nov 29 21:55:27 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:27 user nova-compute[75206]:     </video>
Nov 29 21:55:27 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:27 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:27 user nova-compute[75206]:     </rng>
Nov 29 21:55:27 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:27 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:27 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:27 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:27 user nova-compute[75206]:   </devices>
Nov 29 21:55:27 user nova-compute[75206]: </domain>
Nov 29 21:55:27 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance destroyed successfully.
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:d7:5e:10, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:27 user nova-compute[75206]: WARNING nova.compute.manager [req-f4a30a4b-9bd2-4ab2-ab0d-261d0a9c1414 req-773f8c7a-61ad-496d-8d71-7e1aebd9d32e service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:55:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance running successfully.
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Failed to set time: agent not configured {{(pid=75206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 21:55:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4513f957-981c-4bf9-9c11-8d69d9b0b212 tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] finish_migration finished successfully. {{(pid=75206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 21:55:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4a2ece47-03d2-43f4-8653-c900c29a6d3d req-948834f9-9793-49c7-926a-172bc6afb381 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:30 user nova-compute[75206]: WARNING nova.compute.manager [req-b44dac6a-7adb-4dca-a872-19cbf78c5e53 req-220d5c7c-8b55-4ff9-97f2-28f0e8244d2d service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.compute.manager [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:31 user nova-compute[75206]: WARNING nova.compute.manager [req-2c1d4f53-9368-4c31-b6b0-104efcb3108d req-c196c12e-440b-4deb-a1d3-bbf9e1fad157 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:55:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance spawned successfully.
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75206) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61c34ecf-aa7a-413b-8891-f4af7525c553 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.179s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:55:31 user nova-compute[75206]: INFO nova.compute.claims [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Claim successful on node user
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.986s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:55:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:32 user nova-compute[75206]: WARNING nova.compute.manager [req-c0234114-19dc-48bf-9213-908ffbd75002 req-e1c90e53-10ae-473c-b6f5-3b819408cdda service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state active and task_state rescuing.
Nov 29 21:55:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ec3fffd-1406-4d92-8cde-e3ccabdb9491 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b31d4372-3070-4533-a74b-aa66904e4f4a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG nova.policy [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ccca1ca069d4fbbbb5b7fe82fcbcebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f9fa005995c4873a7af86efee9a05d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:55:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Creating image(s)
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "/opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "/opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "/opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.298s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk 1073741824" returned: 0 in 0.111s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.418s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.240s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Successfully created port: d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Cannot resize image /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Ensure instance console log exists: /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Successfully updated port: d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquired lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-changed-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Refreshing instance network info cache due to event network-changed-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] Acquiring lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.objects.instance [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:35 user nova-compute[75206]: INFO nova.compute.manager [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Attaching volume 45080753-5f3b-4a8a-a1b3-1c62da12f31f to /dev/vdb
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Updating instance_info_cache with network_info: [{"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[162f0491-9c69-4e96-bfbf-38e40598aed8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Releasing lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Instance network_info: |[{"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] Acquired lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Refreshing network info cache for port d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Start _get_guest_xml network_info=[{"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[857bf8db-f467-4e2d-93e1-314158efea15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3318d79f-be87-4d33-a1cc-647909bc6641]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42f1d2-711f-45b0-a9aa-a0db4f1fb969]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:55:35 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9028104-fe12-42c4-ad5b-f0d9b37c4751]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== get_connector_properties: return (238ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating existing volume attachment record: 62e0227c-34e2-4a61-a8bf-f71e07f3518d {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-281486658',display_name='tempest-VolumesNegativeTest-instance-281486658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-281486658',id=30,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f9fa005995c4873a7af86efee9a05d0',ramdisk_id='',reservation_id='r-73e0ng4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1255076566',owner_user_name='tempest-VolumesNegativeTest-1255076566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:55:33Z,user_data=None,user_id='0ccca1ca069d4fbbbb5b7fe82fcbcebd',uuid=408bbe2e-b1e3-4c8e-a128-195c3e3bc466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converting VIF {"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.objects.instance [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lazy-loading 'pci_devices' on Instance uuid 408bbe2e-b1e3-4c8e-a128-195c3e3bc466 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:55:36 user nova-compute[75206]:   <uuid>408bbe2e-b1e3-4c8e-a128-195c3e3bc466</uuid>
Nov 29 21:55:36 user nova-compute[75206]:   <name>instance-0000001e</name>
Nov 29 21:55:36 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:55:36 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:55:36 user nova-compute[75206]:   <metadata>
Nov 29 21:55:36 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:55:36 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:name>tempest-VolumesNegativeTest-instance-281486658</nova:name>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:55:35</nova:creationTime>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:55:36 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:55:36 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:owner>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:user uuid="0ccca1ca069d4fbbbb5b7fe82fcbcebd">tempest-VolumesNegativeTest-1255076566-project-member</nova:user>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:project uuid="5f9fa005995c4873a7af86efee9a05d0">tempest-VolumesNegativeTest-1255076566</nova:project>
Nov 29 21:55:36 user nova-compute[75206]:       </nova:owner>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:55:36 user nova-compute[75206]:       <nova:ports>
Nov 29 21:55:36 user nova-compute[75206]:         <nova:port uuid="d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8">
Nov 29 21:55:36 user nova-compute[75206]:           <nova:ip type="fixed" address="192.168.233.89" ipVersion="4"/>
Nov 29 21:55:36 user nova-compute[75206]:         </nova:port>
Nov 29 21:55:36 user nova-compute[75206]:       </nova:ports>
Nov 29 21:55:36 user nova-compute[75206]:     </nova:instance>
Nov 29 21:55:36 user nova-compute[75206]:   </metadata>
Nov 29 21:55:36 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:55:36 user nova-compute[75206]:     <system>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="serial">408bbe2e-b1e3-4c8e-a128-195c3e3bc466</entry>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="uuid">408bbe2e-b1e3-4c8e-a128-195c3e3bc466</entry>
Nov 29 21:55:36 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:55:36 user nova-compute[75206]:     </system>
Nov 29 21:55:36 user nova-compute[75206]:   </sysinfo>
Nov 29 21:55:36 user nova-compute[75206]:   <os>
Nov 29 21:55:36 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:55:36 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:55:36 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:55:36 user nova-compute[75206]:   </os>
Nov 29 21:55:36 user nova-compute[75206]:   <features>
Nov 29 21:55:36 user nova-compute[75206]:     <acpi/>
Nov 29 21:55:36 user nova-compute[75206]:     <apic/>
Nov 29 21:55:36 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:55:36 user nova-compute[75206]:   </features>
Nov 29 21:55:36 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:55:36 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:55:36 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:55:36 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:55:36 user nova-compute[75206]:   </clock>
Nov 29 21:55:36 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:55:36 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:55:36 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:55:36 user nova-compute[75206]:   </cpu>
Nov 29 21:55:36 user nova-compute[75206]:   <devices>
Nov 29 21:55:36 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:55:36 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:55:36 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk"/>
Nov 29 21:55:36 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:55:36 user nova-compute[75206]:     </disk>
Nov 29 21:55:36 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:55:36 user nova-compute[75206]:       <mac address="fa:16:3e:c8:a5:9d"/>
Nov 29 21:55:36 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:36 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:55:36 user nova-compute[75206]:       <target dev="tapd332fdbd-96"/>
Nov 29 21:55:36 user nova-compute[75206]:     </interface>
Nov 29 21:55:36 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:55:36 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/console.log" append="off"/>
Nov 29 21:55:36 user nova-compute[75206]:     </serial>
Nov 29 21:55:36 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:55:36 user nova-compute[75206]:     <video>
Nov 29 21:55:36 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:55:36 user nova-compute[75206]:     </video>
Nov 29 21:55:36 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:55:36 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:55:36 user nova-compute[75206]:     </rng>
Nov 29 21:55:36 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:55:36 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:55:36 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:55:36 user nova-compute[75206]:     </memballoon>
Nov 29 21:55:36 user nova-compute[75206]:   </devices>
Nov 29 21:55:36 user nova-compute[75206]: </domain>
Nov 29 21:55:36 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-281486658',display_name='tempest-VolumesNegativeTest-instance-281486658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-281486658',id=30,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f9fa005995c4873a7af86efee9a05d0',ramdisk_id='',reservation_id='r-73e0ng4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1255076566',owner_user_name='tempest-VolumesNegativeTest-1255076566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:55:33Z,user_data=None,user_id='0ccca1ca069d4fbbbb5b7fe82fcbcebd',uuid=408bbe2e-b1e3-4c8e-a128-195c3e3bc466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converting VIF {"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG os_vif [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3a2e9a4-007d-5a7d-9ae5-c2d5b817d910', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd332fdbd-96, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd332fdbd-96, col_values=(('qos', UUID('2d163e7f-5cc2-4bd6-8a90-4e0f940c9e58')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd332fdbd-96, col_values=(('external_ids', {'iface-id': 'd332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:a5:9d', 'vm-uuid': '408bbe2e-b1e3-4c8e-a128-195c3e3bc466'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:36 user nova-compute[75206]: INFO os_vif [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96')
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] No VIF found with MAC fa:16:3e:c8:a5:9d, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Updated VIF entry in instance network info cache for port d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Updating instance_info_cache with network_info: [{"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e781eefe-9d1b-4f01-9e86-47e8aed16881 req-b6f436bb-a745-46e9-8fa4-b87393be55a8 service nova] Releasing lock "refresh_cache-408bbe2e-b1e3-4c8e-a128-195c3e3bc466" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json" returned: 0 in 0.331s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] No waiting events found dispatching network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:38 user nova-compute[75206]: WARNING nova.compute.manager [req-6c458344-b2a9-4169-a478-8f475bfc50f6 req-5735ff51-b426-4f81-86e8-08064436f325 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received unexpected event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 for instance with vm_state building and task_state spawning.
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.323s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:39 user nova-compute[75206]: INFO nova.compute.manager [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Terminating instance
Nov 29 21:55:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-4942ae7a-bb96-4e2a-b357-f848ca8bfe23 req-fe2a73e9-143c-41cf-a87f-ad31ce9d9cbd service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] Instance destroyed successfully.
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'resources' on Instance uuid f603593a-9ed6-4750-be67-8004112c5093 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061763209',display_name='tempest-AttachVolumeNegativeTest-server-1061763209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061763209',id=25,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhPOXVIq/VzPF8M5EN2iGhEdl/v4IYL2x8DwtiHmcfvBcbqATGd5t+Bz+8b8vPcnMQkXEjExmM9XVQwo0Zal0wk+REMRl0jyyRFvhjNDad+JQnSZ8wQGh7oBVjRZj57xw==',key_name='tempest-keypair-696768959',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-f4rnw7mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=f603593a-9ed6-4750-be67-8004112c5093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "address": "fa:16:3e:20:2e:73", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0919b5-b0", "ovs_interfaceid": "fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG os_vif [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0919b5-b0, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52fcccb2-4666-4735-a105-0f2d65d88da8) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:55:40 user nova-compute[75206]: INFO os_vif [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:2e:73,bridge_name='br-int',has_traffic_filtering=True,id=fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0919b5-b0')
Nov 29 21:55:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Deleting instance files /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093_del
Nov 29 21:55:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Deletion of /opt/stack/data/nova/instances/f603593a-9ed6-4750-be67-8004112c5093_del complete
Nov 29 21:55:40 user nova-compute[75206]: INFO nova.compute.manager [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: f603593a-9ed6-4750-be67-8004112c5093] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 21:55:40 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:55:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] No waiting events found dispatching network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.compute.manager [req-f0bd4625-2032-4607-ac23-0ec6962d53e4 req-f54e18b4-cbe1-4f5e-9911-3e995ccff1ee service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received unexpected event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 for instance with vm_state building and task_state spawning.
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=24.735698699951172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Instance spawned successfully.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:55:41 user nova-compute[75206]: INFO nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Took 8.31 seconds to spawn the instance on the hypervisor.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Applying migration context for instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 as it has an incoming, in-progress migration fd56d3e5-c907-4450-a3f6-a77579e4dabd. Migration status is finished {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 21:55:41 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating resource usage from migration fd56d3e5-c907-4450-a3f6-a77579e4dabd
Nov 29 21:55:41 user nova-compute[75206]: INFO nova.compute.manager [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Took 9.94 seconds to build instance.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state active and task_state deleting.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state active and task_state deleting.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state active and task_state deleting.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-unplugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Acquiring lock "f603593a-9ed6-4750-be67-8004112c5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] Lock "f603593a-9ed6-4750-be67-8004112c5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] No waiting events found dispatching network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:55:41 user nova-compute[75206]: WARNING nova.compute.manager [req-56528dfa-6fc3-4bff-b099-bcb9d2fe4360 req-82e84dc9-990b-4122-9241-23ed6bcc99ba service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received unexpected event network-vif-plugged-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 for instance with vm_state active and task_state deleting.
Nov 29 21:55:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-03547b2e-51da-48fc-8027-517dabe9ced0 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.202s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f603593a-9ed6-4750-be67-8004112c5093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c7629b50-8d89-407c-b868-d265a029bf32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d7709e06-a10b-46e3-b834-a98c13f4e152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Migration fd56d3e5-c907-4450-a3f6-a77579e4dabd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 408bbe2e-b1e3-4c8e-a128-195c3e3bc466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:55:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:42 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: f603593a-9ed6-4750-be67-8004112c5093] Took 1.84 seconds to deallocate network for instance.
Nov 29 21:55:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-c36d620e-32fa-4fc1-babc-9f8fff897130 req-b16741a4-6dc6-44f6-8fbe-65f0e67ddf1e service nova] [instance: f603593a-9ed6-4750-be67-8004112c5093] Received event network-vif-deleted-fe0919b5-b0fb-4ae9-b51c-c0ef5d9a5b55 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.313s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.437s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:55:43 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:55:43 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:55:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:43 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Deleted allocations for instance f603593a-9ed6-4750-be67-8004112c5093
Nov 29 21:55:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bee852a6-7c7e-4ba3-b8de-9ac78afa433e tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "f603593a-9ed6-4750-be67-8004112c5093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.362s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:55:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:55:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:55:46 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:46 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:55:46 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d1e8b-ac87-412a-bf2f-fe639826e409]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:55:46 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10008567-1ea5-4edd-b790-d74db57c2d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f] added
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cce6d8-480c-4256-93da-57a4660a46ab]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f4185c-f0e4-4dd7-8931-b93cbcd01afa]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSkeoxLC {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSkeoxLC" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606c402-b686-43fe-813f-456f6714a1a9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nSkeoxLC'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aec1ee-9174-4b0a-b14b-74de5992a84a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d2af1-43c0-405c-82ab-fa892df63383]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e17c2e-8c4b-4670-b8d0-1f5afe00a538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]
Nov 29 21:55:46 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a3436-9d95-44c4-9ae6-f2c94f23855b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb28bf-14d8-41b4-ae73-0a0d255d9f35]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:55:46 user nova-compute[75206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:55:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdee1f5-f7d8-487e-a91d-5be39a7910e9]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:55:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:55:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23335336431663633', 'path': '/dev/sdf'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:55:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335336431663633', 'path': '/dev/sdf'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:55:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:55:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:55:47 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:55:47 user nova-compute[75206]:   <source dev="/dev/sdf"/>
Nov 29 21:55:47 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:55:47 user nova-compute[75206]:   <serial>45080753-5f3b-4a8a-a1b3-1c62da12f31f</serial>
Nov 29 21:55:47 user nova-compute[75206]: </disk>
Nov 29 21:55:47 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:55:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:55:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No VIF found with MAC fa:16:3e:53:72:a6, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:55:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-010f73aa-dcf5-49e4-bfd4-f519ed4953a4 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.827s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:55:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing instance network info cache due to event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:55:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updated VIF entry in instance network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:55:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11901ff6-d17d-4979-b569-4660310abb5d req-fb98c497-b988-4030-adea-8b23a805bf96 service nova] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:55:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:55:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:55:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing instance network info cache due to event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:55:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:55:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:55:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:55:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updated VIF entry in instance network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:55:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:55:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-02c24df1-22a6-4c60-84fb-6392621dac6b req-7518caf9-da35-4b3a-8f1d-c936228a9075 service nova] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:03 user nova-compute[75206]: INFO nova.compute.manager [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Rebooting instance
Nov 29 21:56:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:04 user nova-compute[75206]: WARNING nova.compute.manager [req-51c3ab5e-334d-41d7-acc6-4ecad11a0eb0 req-3b57b515-4173-4920-b9ba-3ed841b700ef service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance destroyed successfully.
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'resources' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:04Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa60ee0a-b7, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7991e69a-86f1-4ac9-9a88-5f4734348c99) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:04 user nova-compute[75206]: INFO os_vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7')
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:04 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75009a-75d5-4ae5-aa47-52df839a5486]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:56:04 user nova-compute[75206]: No targets found.
Nov 29 21:56:04 user nova-compute[75206]: iSNS:
Nov 29 21:56:04 user nova-compute[75206]: No targets found.
Nov 29 21:56:04 user nova-compute[75206]: STATIC:
Nov 29 21:56:04 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:56:04 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:04 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:04 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:56:04 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:04 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:04 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:56:04 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:04 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:04 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:56:04 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:04 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:04 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:56:04 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:04 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:04 user nova-compute[75206]: FIRMWARE:
Nov 29 21:56:04 user nova-compute[75206]: No targets found.
Nov 29 21:56:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:56:04 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:56:04 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1054a-2198-45ff-ac0b-fb41254ff68a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f2ed1-a421-48c3-bdaa-1ac5115d1605]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:04 user nova-compute[75206]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b82555a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f'): ({'sdf'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Removing single pathed devices sdf {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33369aa-ef71-4d69-b88e-cd8d8b506d89]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb55118-12e2-43af-bdbf-50c87ccdcf04]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flushing IO for device /dev/sdf {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b871b-f16c-4874-9e2e-6084ed7a0eaf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[635bb464-90ac-4f74-87aa-bf168478f620]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de98b3-c6c5-4c14-88e0-3ab3675dc623]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cc0363-1d1f-414e-a42b-22c574d5cc17]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]
Nov 29 21:56:04 user nova-compute[75206]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.
Nov 29 21:56:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab180541-f6fe-45a2-a179-1f5cf91b48fa]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== disconnect_volume: return (305ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start _get_guest_xml network_info=[{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a27033a8-5eb8-4ee1-a037-38ac6f138341,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a27033a8-5eb8-4ee1-a037-38ac6f138341'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '62e0227c-34e2-4a61-a8bf-f71e07f3518d', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'c7629b50-8d89-407c-b868-d265a029bf32', 'attached_at': '', 'detached_at': '', 'volume_id': '45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'serial': '45080753-5f3b-4a8a-a1b3-1c62da12f31f'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:56:04 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:04 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a27033a8-5eb8-4ee1-a037-38ac6f138341,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:56:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG nova.objects.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Object Instance<c7629b50-8d89-407c-b868-d265a029bf32> lazy-loaded attributes: resources,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:05 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c8cc5-3b08-4991-83c5-ffb0939480ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:56:05 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c61251-e2ac-445a-9f8f-ade11a42faf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f] added
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b61b6e3-e44d-4dc5-9794-39d84768492a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca66bb-60b2-4bf2-9d86-fd519bc49157]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSkeoxLC {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSkeoxLC" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0608b047-6cd3-4004-810c-d4693816ca03]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nSkeoxLC'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb528a-bb96-4bbf-b44b-adb6219e3789]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e447bea-d8db-4ccc-a292-45fc508a1d6f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3652fc-0cd6-4fbd-a705-bfa1382325ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]
Nov 29 21:56:05 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d1d90-e8e9-4f17-9b6e-a3f91458dcc7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d9fcf7-dcfe-4bcb-9100-da38e1804dd6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:05 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfc00e-933a-4f51-b474-f7d413f84dbe]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:56:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:06 user nova-compute[75206]: WARNING nova.compute.manager [req-5e2b7163-82f0-4ea1-b42b-d8321993794e req-87efc266-c655-47fe-aef5-60d134201603 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 21:56:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23335336431663633', 'path': '/dev/sdf'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335336431663633', 'path': '/dev/sdf'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:04Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'pci_devices' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Object Instance<c7629b50-8d89-407c-b868-d265a029bf32> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:56:06 user nova-compute[75206]:   <uuid>c7629b50-8d89-407c-b868-d265a029bf32</uuid>
Nov 29 21:56:06 user nova-compute[75206]:   <name>instance-0000001c</name>
Nov 29 21:56:06 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:56:06 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:56:06 user nova-compute[75206]:   <metadata>
Nov 29 21:56:06 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:56:06 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:name>tempest-TestMinimumBasicScenario-server-1507297911</nova:name>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:56:04</nova:creationTime>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:56:06 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:56:06 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:owner>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:user uuid="e456426697854165bbdd8d8f4a39cd77">tempest-TestMinimumBasicScenario-2060893910-project-member</nova:user>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:project uuid="84edc3e740a04e4eb7cdec55bbc1f4c9">tempest-TestMinimumBasicScenario-2060893910</nova:project>
Nov 29 21:56:06 user nova-compute[75206]:       </nova:owner>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:root type="image" uuid="a27033a8-5eb8-4ee1-a037-38ac6f138341"/>
Nov 29 21:56:06 user nova-compute[75206]:       <nova:ports>
Nov 29 21:56:06 user nova-compute[75206]:         <nova:port uuid="aa60ee0a-b766-405f-a218-28a936489eb9">
Nov 29 21:56:06 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:56:06 user nova-compute[75206]:         </nova:port>
Nov 29 21:56:06 user nova-compute[75206]:       </nova:ports>
Nov 29 21:56:06 user nova-compute[75206]:     </nova:instance>
Nov 29 21:56:06 user nova-compute[75206]:   </metadata>
Nov 29 21:56:06 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:56:06 user nova-compute[75206]:     <system>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="serial">c7629b50-8d89-407c-b868-d265a029bf32</entry>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="uuid">c7629b50-8d89-407c-b868-d265a029bf32</entry>
Nov 29 21:56:06 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:56:06 user nova-compute[75206]:     </system>
Nov 29 21:56:06 user nova-compute[75206]:   </sysinfo>
Nov 29 21:56:06 user nova-compute[75206]:   <os>
Nov 29 21:56:06 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:56:06 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:56:06 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:56:06 user nova-compute[75206]:   </os>
Nov 29 21:56:06 user nova-compute[75206]:   <features>
Nov 29 21:56:06 user nova-compute[75206]:     <acpi/>
Nov 29 21:56:06 user nova-compute[75206]:     <apic/>
Nov 29 21:56:06 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:56:06 user nova-compute[75206]:   </features>
Nov 29 21:56:06 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:56:06 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:56:06 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:56:06 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:56:06 user nova-compute[75206]:   </clock>
Nov 29 21:56:06 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:56:06 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:56:06 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:56:06 user nova-compute[75206]:   </cpu>
Nov 29 21:56:06 user nova-compute[75206]:   <devices>
Nov 29 21:56:06 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:56:06 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:56:06 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk"/>
Nov 29 21:56:06 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:56:06 user nova-compute[75206]:     </disk>
Nov 29 21:56:06 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:56:06 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:56:06 user nova-compute[75206]:       <source dev="/dev/sdf"/>
Nov 29 21:56:06 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:56:06 user nova-compute[75206]:       <serial>45080753-5f3b-4a8a-a1b3-1c62da12f31f</serial>
Nov 29 21:56:06 user nova-compute[75206]:     </disk>
Nov 29 21:56:06 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:56:06 user nova-compute[75206]:       <mac address="fa:16:3e:53:72:a6"/>
Nov 29 21:56:06 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:56:06 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:56:06 user nova-compute[75206]:       <target dev="tapaa60ee0a-b7"/>
Nov 29 21:56:06 user nova-compute[75206]:     </interface>
Nov 29 21:56:06 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:56:06 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/console.log" append="off"/>
Nov 29 21:56:06 user nova-compute[75206]:     </serial>
Nov 29 21:56:06 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:56:06 user nova-compute[75206]:     <video>
Nov 29 21:56:06 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:56:06 user nova-compute[75206]:     </video>
Nov 29 21:56:06 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:56:06 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:56:06 user nova-compute[75206]:     </rng>
Nov 29 21:56:06 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:56:06 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:56:06 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:56:06 user nova-compute[75206]:     </memballoon>
Nov 29 21:56:06 user nova-compute[75206]:   </devices>
Nov 29 21:56:06 user nova-compute[75206]: </domain>
Nov 29 21:56:06 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG nova.objects.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Object Instance<c7629b50-8d89-407c-b868-d265a029bf32> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Cannot resize image /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'migration_context' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.objects.base [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Object Instance<c7629b50-8d89-407c-b868-d265a029bf32> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:56:04Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG os_vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73748ceb-ed66-5bf3-8235-fb2eac6cce52', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa60ee0a-b7, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa60ee0a-b7, col_values=(('qos', UUID('e07e30ac-166b-4d3f-922f-67508ee54d04')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa60ee0a-b7, col_values=(('external_ids', {'iface-id': 'aa60ee0a-b766-405f-a218-28a936489eb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:72:a6', 'vm-uuid': 'c7629b50-8d89-407c-b868-d265a029bf32'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:07 user nova-compute[75206]: INFO os_vif [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7')
Nov 29 21:56:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:08 user nova-compute[75206]: WARNING nova.compute.manager [req-c2b8840d-ba52-4222-aa89-2168c4b85423 req-feba4eb6-1014-4d00-a125-57d5bb92e6e2 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 21:56:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:56:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance rebooted successfully.
Nov 29 21:56:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:11 user nova-compute[75206]: WARNING nova.compute.manager [req-91fe917b-66d0-42ae-acf1-d5c89db085fc req-d6dfb7d7-ed51-49ad-84fd-9d7485869b57 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 21:56:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0d99e620-aeca-42a2-9d67-10f43391f16b tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.925s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG nova.objects.instance [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:12 user nova-compute[75206]: INFO nova.compute.manager [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Attaching volume 81879963-09df-4eac-93bc-0898e43b6490 to /dev/vdb
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7616a0f-0b41-47e9-8441-3ceadae2aec0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00fa14-2285-4830-a159-27878acf8977]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a6a62-92ae-4720-8755-35be4e2ebe89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d153a2-9b08-4323-be26-8d6cf1c49d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:56:12 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:56:12 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b52d54a-7b1f-44f5-9f1f-fb42d2c2ccde]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG os_brick.utils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:12 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating existing volume attachment record: 43f0a06a-40c7-460d-bc8b-ca03c99c84a2 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing instance network info cache due to event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] Acquiring lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] Acquired lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing network info cache for port e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updated VIF entry in instance network info cache for port e25002f1-1f6a-44af-9cba-3993eb00c1a3. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating instance_info_cache with network_info: [{"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6835c66e-689d-464a-95cc-6b6d7f6c0df0 req-cbd4d30d-5be8-42be-81ed-cc835f579b65 service nova] Releasing lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:23 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTRqcuSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:24 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:24 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:24 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f275efb-9213-4ee6-b5c5-b713b061f8ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:56:24 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc66397-1dea-4edc-af8c-0f49a8f5532f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490] added
Nov 29 21:56:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9453a25-aa48-4de7-ba65-76249adbbe7f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd862fb4-9755-4e50-abb8-496ba03fa9dd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTRqcuSW {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTRqcuSW" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613c8d7-619f-45cc-87df-d2fba9684bc6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTRqcuSW'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4891e06d-5b55-45cf-9122-85ff4ac7cb32]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50189692-2017-43b9-85f4-37bd15168ef6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:24 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:24 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04fc51f-0e40-46a5-a12f-b537e819ec5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260]
Nov 29 21:56:25 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260] successful.
Nov 29 21:56:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd600d6-3e18-48a6-b15a-3b6ab4a329f3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[332dc2d7-9607-4965-8b32-95efc318bd08]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:25 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1d8f2-4e34-44f2-a16b-ad7508086271]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTRqcuSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26362313433303536', 'path': '/dev/sdg'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313433303536', 'path': '/dev/sdg'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:56:26 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:56:26 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 21:56:26 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:56:26 user nova-compute[75206]:   <serial>81879963-09df-4eac-93bc-0898e43b6490</serial>
Nov 29 21:56:26 user nova-compute[75206]: </disk>
Nov 29 21:56:26 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] No VIF found with MAC fa:16:3e:83:8e:2b, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-21c02e10-e0e9-41ed-81ad-7d86615cdf29 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.354s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:28 user nova-compute[75206]: INFO nova.compute.manager [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Detaching volume 81879963-09df-4eac-93bc-0898e43b6490
Nov 29 21:56:29 user nova-compute[75206]: INFO nova.virt.block_device [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Attempting to driver detach volume 81879963-09df-4eac-93bc-0898e43b6490 from mountpoint /dev/vdb
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Attempting to detach device vdb from instance d7709e06-a10b-46e3-b834-a98c13f4e152 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:56:29 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:56:29 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 21:56:29 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:56:29 user nova-compute[75206]:   <serial>81879963-09df-4eac-93bc-0898e43b6490</serial>
Nov 29 21:56:29 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:56:29 user nova-compute[75206]: </disk>
Nov 29 21:56:29 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:29 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully detached device vdb from instance d7709e06-a10b-46e3-b834-a98c13f4e152 from the persistent domain config.
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7709e06-a10b-46e3-b834-a98c13f4e152 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:56:29 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:56:29 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 21:56:29 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:56:29 user nova-compute[75206]:   <serial>81879963-09df-4eac-93bc-0898e43b6490</serial>
Nov 29 21:56:29 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:56:29 user nova-compute[75206]: </disk>
Nov 29 21:56:29 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=6854MB free_disk=24.693458557128906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Applying migration context for instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 as it has an incoming, in-progress migration fd56d3e5-c907-4450-a3f6-a77579e4dabd. Migration status is finished {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 21:56:31 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating resource usage from migration fd56d3e5-c907-4450-a3f6-a77579e4dabd
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c7629b50-8d89-407c-b868-d265a029bf32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d7709e06-a10b-46e3-b834-a98c13f4e152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Migration fd56d3e5-c907-4450-a3f6-a77579e4dabd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 408bbe2e-b1e3-4c8e-a128-195c3e3bc466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.815s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:56:33 user nova-compute[75206]: INFO nova.compute.claims [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Claim successful on node user
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:56:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.policy [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9befc13bc6ec4d6fb37d297c6927602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8009177c2d4cebaee3848aba1eeded', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:56:34 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Creating image(s)
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "/opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "/opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.168s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk 1073741824" returned: 0 in 0.048s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Successfully created port: e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Cannot resize image /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Ensure instance console log exists: /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 21:56:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Successfully updated port: e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquired lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-changed-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Refreshing instance network info cache due to event network-changed-e08bd634-f27a-458e-a48b-21761864a105. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] Acquiring lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updating instance_info_cache with network_info: [{"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Releasing lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Instance network_info: |[{"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] Acquired lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Refreshing network info cache for port e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Start _get_guest_xml network_info=[{"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:56:36 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:36 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2081985667',display_name='tempest-AttachVolumeNegativeTest-server-2081985667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2081985667',id=31,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEI54TJnPqSIZb9KKJ7/ik6++xGTmR2b7Qu0GtwztCaB/M1emjcbtvZaPY2OuZxI+C1lLIM82XdOMAaUXoBMCTw7ZS4rhCnONpJw+ni7Rex+ty7r/8W1QIEB/dCBrIZYQ==',key_name='tempest-keypair-2044573087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-or0losbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=25604878-4b0e-406f-bdf0-50b72f9ee117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.objects.instance [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'pci_devices' on Instance uuid 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:56:36 user nova-compute[75206]:   <uuid>25604878-4b0e-406f-bdf0-50b72f9ee117</uuid>
Nov 29 21:56:36 user nova-compute[75206]:   <name>instance-0000001f</name>
Nov 29 21:56:36 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:56:36 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:56:36 user nova-compute[75206]:   <metadata>
Nov 29 21:56:36 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:56:36 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2081985667</nova:name>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:56:36</nova:creationTime>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:56:36 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:56:36 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:owner>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:user uuid="9befc13bc6ec4d6fb37d297c6927602f">tempest-AttachVolumeNegativeTest-330553211-project-member</nova:user>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:project uuid="9e8009177c2d4cebaee3848aba1eeded">tempest-AttachVolumeNegativeTest-330553211</nova:project>
Nov 29 21:56:36 user nova-compute[75206]:       </nova:owner>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:56:36 user nova-compute[75206]:       <nova:ports>
Nov 29 21:56:36 user nova-compute[75206]:         <nova:port uuid="e08bd634-f27a-458e-a48b-21761864a105">
Nov 29 21:56:36 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 21:56:36 user nova-compute[75206]:         </nova:port>
Nov 29 21:56:36 user nova-compute[75206]:       </nova:ports>
Nov 29 21:56:36 user nova-compute[75206]:     </nova:instance>
Nov 29 21:56:36 user nova-compute[75206]:   </metadata>
Nov 29 21:56:36 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:56:36 user nova-compute[75206]:     <system>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="serial">25604878-4b0e-406f-bdf0-50b72f9ee117</entry>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="uuid">25604878-4b0e-406f-bdf0-50b72f9ee117</entry>
Nov 29 21:56:36 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:56:36 user nova-compute[75206]:     </system>
Nov 29 21:56:36 user nova-compute[75206]:   </sysinfo>
Nov 29 21:56:36 user nova-compute[75206]:   <os>
Nov 29 21:56:36 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:56:36 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:56:36 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:56:36 user nova-compute[75206]:   </os>
Nov 29 21:56:36 user nova-compute[75206]:   <features>
Nov 29 21:56:36 user nova-compute[75206]:     <acpi/>
Nov 29 21:56:36 user nova-compute[75206]:     <apic/>
Nov 29 21:56:36 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:56:36 user nova-compute[75206]:   </features>
Nov 29 21:56:36 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:56:36 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:56:36 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:56:36 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:56:36 user nova-compute[75206]:   </clock>
Nov 29 21:56:36 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:56:36 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:56:36 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:56:36 user nova-compute[75206]:   </cpu>
Nov 29 21:56:36 user nova-compute[75206]:   <devices>
Nov 29 21:56:36 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:56:36 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:56:36 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk"/>
Nov 29 21:56:36 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:56:36 user nova-compute[75206]:     </disk>
Nov 29 21:56:36 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:56:36 user nova-compute[75206]:       <mac address="fa:16:3e:a2:07:d5"/>
Nov 29 21:56:36 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:56:36 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:56:36 user nova-compute[75206]:       <target dev="tape08bd634-f2"/>
Nov 29 21:56:36 user nova-compute[75206]:     </interface>
Nov 29 21:56:36 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:56:36 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/console.log" append="off"/>
Nov 29 21:56:36 user nova-compute[75206]:     </serial>
Nov 29 21:56:36 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:56:36 user nova-compute[75206]:     <video>
Nov 29 21:56:36 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:56:36 user nova-compute[75206]:     </video>
Nov 29 21:56:36 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:56:36 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:56:36 user nova-compute[75206]:     </rng>
Nov 29 21:56:36 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:56:36 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:56:36 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:56:36 user nova-compute[75206]:     </memballoon>
Nov 29 21:56:36 user nova-compute[75206]:   </devices>
Nov 29 21:56:36 user nova-compute[75206]: </domain>
Nov 29 21:56:36 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2081985667',display_name='tempest-AttachVolumeNegativeTest-server-2081985667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2081985667',id=31,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEI54TJnPqSIZb9KKJ7/ik6++xGTmR2b7Qu0GtwztCaB/M1emjcbtvZaPY2OuZxI+C1lLIM82XdOMAaUXoBMCTw7ZS4rhCnONpJw+ni7Rex+ty7r/8W1QIEB/dCBrIZYQ==',key_name='tempest-keypair-2044573087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-or0losbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=25604878-4b0e-406f-bdf0-50b72f9ee117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG os_vif [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '166dfe79-092d-5fca-b8b4-e35eaa396e8e', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape08bd634-f2, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape08bd634-f2, col_values=(('qos', UUID('a1eb3765-b30c-4593-8fdd-d9776dcba031')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape08bd634-f2, col_values=(('external_ids', {'iface-id': 'e08bd634-f27a-458e-a48b-21761864a105', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:07:d5', 'vm-uuid': '25604878-4b0e-406f-bdf0-50b72f9ee117'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:36 user nova-compute[75206]: INFO os_vif [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2')
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:a2:07:d5, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updated VIF entry in instance network info cache for port e08bd634-f27a-458e-a48b-21761864a105. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG nova.network.neutron [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updating instance_info_cache with network_info: [{"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-041cb8f0-bd6f-4478-b292-b4b1bfdcdbd0 req-f0131e9b-5964-463f-af5e-4416b516008d service nova] Releasing lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] No waiting events found dispatching network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:38 user nova-compute[75206]: WARNING nova.compute.manager [req-34e3fbb1-d4e5-4344-84c4-7f1ae93ca37a req-eb9b8983-54ed-4121-870f-3a29de1b237a service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received unexpected event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 for instance with vm_state building and task_state spawning.
Nov 29 21:56:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Port ebe76bc7-4889-4a62-8564-3a3cd230d96e binding to destination host user is already ACTIVE {{(pid=75206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:38 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Creating tmpfile /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/tmp223gz57g to verify with other compute node that the instance is on the same shared storage. {{(pid=75206) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance destroyed successfully.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'resources' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebe76bc7-48, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be007be6-4363-42e4-b5be-3d0730b9f8f9) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:40 user nova-compute[75206]: INFO os_vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c3c30-8639-48ce-aea6-c0dcb8f6b5e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:56:40 user nova-compute[75206]: No targets found.
Nov 29 21:56:40 user nova-compute[75206]: iSNS:
Nov 29 21:56:40 user nova-compute[75206]: No targets found.
Nov 29 21:56:40 user nova-compute[75206]: STATIC:
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:56:40 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:40 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:40 user nova-compute[75206]: FIRMWARE:
Nov 29 21:56:40 user nova-compute[75206]: No targets found.
Nov 29 21:56:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:56:40 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:56:40 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48159259-b4a0-4574-b83a-93ce3e624b84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acee8e9-ec11-48e8-97ff-a0047cd914bf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:40 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8079360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ef9588-507e-4aff-9d61-0189b7a4d4d5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5af808-d8f3-4d7a-b63e-0a93e850bddd]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7308bf82-2c42-4ed2-acc3-8bf88bc702e2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:56:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Instance spawned successfully.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb292e51-0d3b-4b25-acbb-5474591ea3dd]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abdff43-c701-4067-b5ca-729c1abbf4f4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] No waiting events found dispatching network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:40 user nova-compute[75206]: WARNING nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received unexpected event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 for instance with vm_state building and task_state spawning.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:40 user nova-compute[75206]: WARNING nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state resized and task_state resize_reverting.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:40 user nova-compute[75206]: WARNING nova.compute.manager [req-ccb18fad-8552-4be1-9965-a79a846451d1 req-60b3398a-316f-485e-8e7a-05846d4eecac service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state resized and task_state resize_reverting.
Nov 29 21:56:40 user nova-compute[75206]: INFO nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd61bcf-7dfc-4833-b240-9bad6712a547]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:56:40 user nova-compute[75206]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:56:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[933978ce-654c-4295-b59f-1ec30755ca95]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== disconnect_volume: return (359ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:56:40 user nova-compute[75206]: INFO nova.compute.manager [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Took 7.03 seconds to build instance.
Nov 29 21:56:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4737c8c2-33c9-407f-b188-9cfeca3f9019 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.125s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:44 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'migration_context' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.objects.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Object Instance<1d5f34b2-1301-4d46-9183-55c070ba28d5> lazy-loaded attributes: resources,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:56:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.879s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:46 user nova-compute[75206]: INFO nova.compute.manager [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Swapping old allocation on dict_keys(['51ff9dac-8442-4423-a757-45ab0a497b95']) held by migration fd56d3e5-c907-4450-a3f6-a77579e4dabd for instance
Nov 29 21:56:46 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Overwriting current allocation {'allocations': {'51ff9dac-8442-4423-a757-45ab0a497b95': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': '44f2c15727dc47e19d00ff536db432df', 'user_id': 'e37b628d0f0a460aa528e4185c4b6683', 'consumer_generation': 1} on consumer 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.utils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cec1ce-81f8-47de-a470-3df6d65125b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a727d64-c01a-483f-9020-ed99078e07e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2109f56a-9aeb-4f7b-9882-c39b539c233e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc756c92-4822-4b83-b86d-dbaf78f92090]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:56:46 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:56:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a44f44-ea39-4f83-9e33-43a489b7da20]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG os_brick.utils [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:49 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7709e06-a10b-46e3-b834-a98c13f4e152 is timed out.
Nov 29 21:56:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully detached device vdb from instance d7709e06-a10b-46e3-b834-a98c13f4e152 from the live domain config.
Nov 29 21:56:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTRqcuSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:56:49 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[534cc546-f7ce-4a7a-b56d-46c4ac1cc147]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:56:49 user nova-compute[75206]: No targets found.
Nov 29 21:56:49 user nova-compute[75206]: iSNS:
Nov 29 21:56:49 user nova-compute[75206]: No targets found.
Nov 29 21:56:49 user nova-compute[75206]: STATIC:
Nov 29 21:56:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:56:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:56:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:56:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490
Nov 29 21:56:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:56:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:56:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:56:49 user nova-compute[75206]: FIRMWARE:
Nov 29 21:56:49 user nova-compute[75206]: No targets found.
Nov 29 21:56:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:56:49 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:56:49 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce45a8-f12d-48c6-bd2b-4bb4b6cc228d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7140de4-018f-4191-8597-3042b4fe3108]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:56:49 user nova-compute[75206]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 (non-flash)
Nov 29 21:56:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c807cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490'): ({'sdg'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Removing single pathed devices sdg {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[390649ab-1b19-45a6-b902-60020c00c3ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14120bf1-3610-481e-8d25-6736c90e313e]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Flushing IO for device /dev/sdg {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da6d9ec-fb39-4c2f-9abd-075dc96c4c34]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.132s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a771b-3209-4ee8-9b5c-8facde60cf2d]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5449847-e486-48d1-97e2-adb638e860e2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cc144d-7636-4f47-8b41-351c6d714c8d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260]
Nov 29 21:56:50 user nova-compute[75206]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490, portal: 172.16.0.220,3260] successful.
Nov 29 21:56:50 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81879963-09df-4eac-93bc-0898e43b6490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.239s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94cd7ba-550a-4225-a085-a2b1850f6e21]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.627s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] <== disconnect_volume: return (628ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:56:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:51 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'flavor' on Instance uuid d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d463d62a-cdc5-4366-b5fd-bfeb33fe9bb3 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.200s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:54 user nova-compute[75206]: INFO nova.compute.manager [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Unrescuing
Nov 29 21:56:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:56:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:56:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'flavor' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:55 user nova-compute[75206]: WARNING nova.compute.manager [req-4d2b75f0-f3cf-443c-928e-9ac1063fe5b5 req-233585d1-f1c8-43cc-9239-4e430fb7dfee service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance destroyed successfully.
Nov 29 21:56:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:57 user nova-compute[75206]: WARNING nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:56:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:57 user nova-compute[75206]: WARNING nova.compute.manager [req-3ea876d5-40fb-4df2-a41b-a80ee1748930 req-bbd2c3d4-74fa-4b69-9fab-1e40fe1f57aa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:56:59 user nova-compute[75206]: DEBUG nova.compute.manager [None req-f933bfbb-f0f5-475e-bdb1-b3dcd7d26567 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:56:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:56:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:56:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:56:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:56:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:56:59 user nova-compute[75206]: WARNING nova.compute.manager [req-2a547470-586b-4b67-8558-b90ec2239381 req-be9bfaee-9e1e-4a48-b093-a21d71d55dfa service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state None.
Nov 29 21:57:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Starting finish_revert_migration {{(pid=75206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start _get_guest_xml network_info=[{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '0ecc7fb9-6169-4940-8197-cfa4fb3f913f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1d5f34b2-1301-4d46-9183-55c070ba28d5', 'attached_at': '2023-11-29T21:57:06.000000', 'detached_at': '', 'volume_id': 'fd1ecab4-3282-4065-b907-c3d5ab205bff', 'serial': 'fd1ecab4-3282-4065-b907-c3d5ab205bff'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:57:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:57:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:57:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:57:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:57:06 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3a2ca-3796-488f-bf28-d0fa8fe85a5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:57:06 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49aebf6-30e0-4d8d-a6c0-153abe6eb6db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff] added
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3873ac-0662-4b93-ae84-848a4f9dbb20]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a37315-4201-4186-aa5a-998077082218]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cNCtFRvT" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4cd9f9-eefa-4832-b638-f102f04f958c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cNCtFRvT'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7b7f9-015c-4219-a6be-0f13f7a95488]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c43875-69e4-492f-b11f-dbca500d9c65]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd11fd-2ed6-41a2-9f5d-b40046c6014c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:57:06 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d867e-98a6-4f87-af1a-60c9f6ceb92e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[270b1f51-a312-4ae2-8129-1b88fe17c127]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:57:06 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:57:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[514022df-0206-40d1-a2de-e3b159040c9d]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:57:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333393631373732', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:57:07 user nova-compute[75206]:   <uuid>1d5f34b2-1301-4d46-9183-55c070ba28d5</uuid>
Nov 29 21:57:07 user nova-compute[75206]:   <name>instance-00000015</name>
Nov 29 21:57:07 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:57:07 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:57:07 user nova-compute[75206]:   <metadata>
Nov 29 21:57:07 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:57:07 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherB-server-1888886025</nova:name>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:57:06</nova:creationTime>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:57:07 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:57:07 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:owner>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:user uuid="e37b628d0f0a460aa528e4185c4b6683">tempest-ServerActionsTestOtherB-957997184-project-member</nova:user>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:project uuid="44f2c15727dc47e19d00ff536db432df">tempest-ServerActionsTestOtherB-957997184</nova:project>
Nov 29 21:57:07 user nova-compute[75206]:       </nova:owner>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:57:07 user nova-compute[75206]:       <nova:ports>
Nov 29 21:57:07 user nova-compute[75206]:         <nova:port uuid="ebe76bc7-4889-4a62-8564-3a3cd230d96e">
Nov 29 21:57:07 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:57:07 user nova-compute[75206]:         </nova:port>
Nov 29 21:57:07 user nova-compute[75206]:       </nova:ports>
Nov 29 21:57:07 user nova-compute[75206]:     </nova:instance>
Nov 29 21:57:07 user nova-compute[75206]:   </metadata>
Nov 29 21:57:07 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:57:07 user nova-compute[75206]:     <system>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="serial">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="uuid">1d5f34b2-1301-4d46-9183-55c070ba28d5</entry>
Nov 29 21:57:07 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:57:07 user nova-compute[75206]:     </system>
Nov 29 21:57:07 user nova-compute[75206]:   </sysinfo>
Nov 29 21:57:07 user nova-compute[75206]:   <os>
Nov 29 21:57:07 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:57:07 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:57:07 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:57:07 user nova-compute[75206]:   </os>
Nov 29 21:57:07 user nova-compute[75206]:   <features>
Nov 29 21:57:07 user nova-compute[75206]:     <acpi/>
Nov 29 21:57:07 user nova-compute[75206]:     <apic/>
Nov 29 21:57:07 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:57:07 user nova-compute[75206]:   </features>
Nov 29 21:57:07 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:57:07 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:57:07 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:57:07 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:57:07 user nova-compute[75206]:   </clock>
Nov 29 21:57:07 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:57:07 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:57:07 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:57:07 user nova-compute[75206]:   </cpu>
Nov 29 21:57:07 user nova-compute[75206]:   <devices>
Nov 29 21:57:07 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:57:07 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:57:07 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk"/>
Nov 29 21:57:07 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:57:07 user nova-compute[75206]:     </disk>
Nov 29 21:57:07 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 21:57:07 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:07 user nova-compute[75206]:       <source dev="/dev/sdd"/>
Nov 29 21:57:07 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 21:57:07 user nova-compute[75206]:       <serial>fd1ecab4-3282-4065-b907-c3d5ab205bff</serial>
Nov 29 21:57:07 user nova-compute[75206]:     </disk>
Nov 29 21:57:07 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:57:07 user nova-compute[75206]:       <mac address="fa:16:3e:2d:f2:ae"/>
Nov 29 21:57:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:57:07 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:57:07 user nova-compute[75206]:       <target dev="tapebe76bc7-48"/>
Nov 29 21:57:07 user nova-compute[75206]:     </interface>
Nov 29 21:57:07 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:57:07 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/console.log" append="off"/>
Nov 29 21:57:07 user nova-compute[75206]:     </serial>
Nov 29 21:57:07 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:57:07 user nova-compute[75206]:     <video>
Nov 29 21:57:07 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:57:07 user nova-compute[75206]:     </video>
Nov 29 21:57:07 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:57:07 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:57:07 user nova-compute[75206]:     </rng>
Nov 29 21:57:07 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:57:07 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:57:07 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:57:07 user nova-compute[75206]:     </memballoon>
Nov 29 21:57:07 user nova-compute[75206]:   </devices>
Nov 29 21:57:07 user nova-compute[75206]: </domain>
Nov 29 21:57:07 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG os_vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b45c3ed-b673-565d-b75a-4cfc9bf8212f', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebe76bc7-48, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebe76bc7-48, col_values=(('qos', UUID('45f613f8-6982-4645-9589-5b108ebbf331')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebe76bc7-48, col_values=(('external_ids', {'iface-id': 'ebe76bc7-4889-4a62-8564-3a3cd230d96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:ae', 'vm-uuid': '1d5f34b2-1301-4d46-9183-55c070ba28d5'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:57:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:07 user nova-compute[75206]: INFO os_vif [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:09 user nova-compute[75206]: WARNING nova.compute.manager [req-f39c6d1a-6073-48af-94dd-08a511e98fa5 req-686fa424-3ef8-49b1-87a0-2be4cfbe7c57 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state resized and task_state resize_reverting.
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:57:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance running successfully.
Nov 29 21:57:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] finish_revert_migration finished successfully. {{(pid=75206) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:11 user nova-compute[75206]: WARNING nova.compute.manager [req-580c4733-0b26-484b-845b-a2dabca0611a req-43a96bfa-a0ed-4af1-b568-841758ff1963 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state resized and task_state resize_reverting.
Nov 29 21:57:11 user nova-compute[75206]: INFO nova.compute.manager [None req-f262210c-7147-4bf9-a0cc-e0d2837f280b tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance to original state: 'active'
Nov 29 21:57:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:12 user nova-compute[75206]: INFO nova.compute.manager [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Unrescuing
Nov 29 21:57:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'flavor' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:13 user nova-compute[75206]: WARNING nova.compute.manager [req-f621f2d3-8391-4dfb-88e8-a11c97955d07 req-34a209ed-48b8-4148-9145-44b3ae664daf service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance destroyed successfully.
Nov 29 21:57:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing instance network info cache due to event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updated VIF entry in instance network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29a37769-1b33-4bc9-a567-e63502d9c790 req-c7b50f95-d24b-4299-882a-15fcbc814bb8 service nova] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:15 user nova-compute[75206]: WARNING nova.compute.manager [req-6a7c6d6a-ce4a-488d-9403-94df3d704074 req-fe38257b-0b3f-4894-9078-d971a185834c service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:16 user nova-compute[75206]: INFO nova.compute.manager [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Unrescuing
Nov 29 21:57:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing instance network info cache due to event network-changed-2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.network.neutron [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Refreshing network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.network.neutron [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:16 user nova-compute[75206]: DEBUG nova.objects.instance [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'flavor' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.network.neutron [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updated VIF entry in instance network info cache for port 2d0df5d7-9c74-49f7-a2cd-dec9050dd926. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.network.neutron [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-29db5650-14a8-4d3e-a524-a62d40eadfd9 req-9aefd1a8-1ed5-4ec5-938f-cf3ed15b2ccb service nova] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:17 user nova-compute[75206]: WARNING nova.compute.manager [req-623237cc-25fc-421b-98cf-943e9037a6d7 req-0c966e64-7a1d-4f06-8231-20f50e38a15f service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance destroyed successfully.
Nov 29 21:57:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:17 user nova-compute[75206]: WARNING nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:17 user nova-compute[75206]: WARNING nova.compute.manager [req-43b86c6e-ba7d-4a2f-88b2-a846fb91e511 req-05f8a5ff-18d9-4cdc-ad4c-047a68a48cf4 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:18 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3da810f6-f805-4d05-aa29-f6b0816382f7 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:57:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:19 user nova-compute[75206]: WARNING nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:19 user nova-compute[75206]: WARNING nova.compute.manager [req-bf7626aa-6793-4c4e-85a1-f45b3e8d5507 req-f720088b-3c96-4500-bf56-2ca4dbca6c75 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:20 user nova-compute[75206]: INFO nova.compute.manager [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Terminating instance
Nov 29 21:57:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance destroyed successfully.
Nov 29 21:57:20 user nova-compute[75206]: DEBUG nova.objects.instance [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'resources' on Instance uuid d7709e06-a10b-46e3-b834-a98c13f4e152 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:54:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1777315192',display_name='tempest-TestStampPattern-server-1777315192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1777315192',id=29,image_ref='7f37fd7d-91c5-48e2-9722-ef38b6b45775',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:54:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-v7zgvy2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bd696537-2a16-49bf-b4aa-f3bb98ec609f',image_min_disk='1',image_min_ram='0',image_owner_id='049af7fc294f49358608d0ab6a9b8d4f',image_owner_project_name='tempest-TestStampPattern-1622973448',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1622973448-project-member',image_user_id='e74a3cb54432457683dd38e8363528e7',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:54:27Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=d7709e06-a10b-46e3-b834-a98c13f4e152,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG os_vif [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape25002f1-1f, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c46f607e-5c0c-4686-b770-fa5af89a552c) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:57:20 user nova-compute[75206]: INFO os_vif [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8e:2b,bridge_name='br-int',has_traffic_filtering=True,id=e25002f1-1f6a-44af-9cba-3993eb00c1a3,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25002f1-1f')
Nov 29 21:57:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Deleting instance files /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152_del
Nov 29 21:57:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Deletion of /opt/stack/data/nova/instances/d7709e06-a10b-46e3-b834-a98c13f4e152_del complete
Nov 29 21:57:21 user nova-compute[75206]: INFO nova.compute.manager [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:21 user nova-compute[75206]: WARNING nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state rescued and task_state unrescuing.
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing instance network info cache due to event network-changed-e25002f1-1f6a-44af-9cba-3993eb00c1a3. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Acquiring lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Acquired lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Refreshing network info cache for port e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-4a6f983a-089c-4f17-9d4a-b10f58add805 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:21 user nova-compute[75206]: INFO nova.compute.manager [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Terminating instance
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:57:21 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:21 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Took 0.94 seconds to deallocate network for instance.
Nov 29 21:57:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Instance destroyed successfully.
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lazy-loading 'resources' on Instance uuid 408bbe2e-b1e3-4c8e-a128-195c3e3bc466 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-281486658',display_name='tempest-VolumesNegativeTest-instance-281486658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-281486658',id=30,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f9fa005995c4873a7af86efee9a05d0',ramdisk_id='',reservation_id='r-73e0ng4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1255076566',owner_user_name='tempest-VolumesNegativeTest-1255076566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:55:42Z,user_data=None,user_id='0ccca1ca069d4fbbbb5b7fe82fcbcebd',uuid=408bbe2e-b1e3-4c8e-a128-195c3e3bc466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converting VIF {"id": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "address": "fa:16:3e:c8:a5:9d", "network": {"id": "27b58496-ead1-4b0d-abb4-c19b74a0914a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a10cf012105e4b0dab3cb14558561298", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd332fdbd-96", "ovs_interfaceid": "d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG os_vif [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd332fdbd-96, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d163e7f-5cc2-4bd6-8a90-4e0f940c9e58) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:57:22 user nova-compute[75206]: INFO os_vif [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a5:9d,bridge_name='br-int',has_traffic_filtering=True,id=d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8,network=Network(27b58496-ead1-4b0d-abb4-c19b74a0914a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd332fdbd-96')
Nov 29 21:57:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Deleting instance files /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466_del
Nov 29 21:57:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Deletion of /opt/stack/data/nova/instances/408bbe2e-b1e3-4c8e-a128-195c3e3bc466_del complete
Nov 29 21:57:22 user nova-compute[75206]: INFO nova.compute.manager [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 21:57:22 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:57:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Deleted allocations for instance d7709e06-a10b-46e3-b834-a98c13f4e152
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updated VIF entry in instance network info cache for port e25002f1-1f6a-44af-9cba-3993eb00c1a3. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Updating instance_info_cache with network_info: [{"id": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "address": "fa:16:3e:83:8e:2b", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25002f1-1f", "ovs_interfaceid": "e25002f1-1f6a-44af-9cba-3993eb00c1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Releasing lock "refresh_cache-d7709e06-a10b-46e3-b834-a98c13f4e152" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-unplugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] No waiting events found dispatching network-vif-unplugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-unplugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Acquiring lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] No waiting events found dispatching network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:23 user nova-compute[75206]: WARNING nova.compute.manager [req-95defe77-21ed-4eee-8f36-3283758bc9fa req-60140e45-461d-478d-bba4-42cde318c530 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received unexpected event network-vif-plugged-e25002f1-1f6a-44af-9cba-3993eb00c1a3 for instance with vm_state active and task_state deleting.
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-92b903f1-35ef-48e6-91fc-f0c255307860 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "d7709e06-a10b-46e3-b834-a98c13f4e152" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Received event network-vif-deleted-e25002f1-1f6a-44af-9cba-3993eb00c1a3 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:23 user nova-compute[75206]: INFO nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Neutron deleted interface e25002f1-1f6a-44af-9cba-3993eb00c1a3; detaching it from the instance and deleting it from the info cache
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Instance is deleted, no further info cache update {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: d7709e06-a10b-46e3-b834-a98c13f4e152] Detach interface failed, port_id=e25002f1-1f6a-44af-9cba-3993eb00c1a3, reason: Instance d7709e06-a10b-46e3-b834-a98c13f4e152 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-unplugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] No waiting events found dispatching network-vif-unplugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-unplugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Acquiring lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] No waiting events found dispatching network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:57:23 user nova-compute[75206]: WARNING nova.compute.manager [req-4bfe07b1-fe4b-4176-b3c0-1c94f3118f67 req-8fdf9178-9d7b-4f45-a745-a9e3f2224878 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received unexpected event network-vif-plugged-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 for instance with vm_state active and task_state deleting.
Nov 29 21:57:23 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:23 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Took 1.00 seconds to deallocate network for instance.
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.218s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:57:24 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Deleted allocations for instance 408bbe2e-b1e3-4c8e-a128-195c3e3bc466
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-98bb097a-9bcc-41d1-af1f-ae2ebdba8d69 tempest-VolumesNegativeTest-1255076566 tempest-VolumesNegativeTest-1255076566-project-member] Lock "408bbe2e-b1e3-4c8e-a128-195c3e3bc466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-2279e8e1-091f-4508-8b4e-3a894474eeac req-3aaf7d70-de52-430c-8f61-f2e65743def7 service nova] [instance: 408bbe2e-b1e3-4c8e-a128-195c3e3bc466] Received event network-vif-deleted-d332fdbd-96a1-4ffa-aa86-24d1f4dd6ee8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:57:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:57:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:57:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:57:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=24.718597412109375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance bd696537-2a16-49bf-b4aa-f3bb98ec609f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c7629b50-8d89-407c-b868-d265a029bf32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 25604878-4b0e-406f-bdf0-50b72f9ee117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:57:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [{"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-1d5f34b2-1301-4d46-9183-55c070ba28d5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:57:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:57:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:42 user nova-compute[75206]: INFO nova.compute.manager [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Detaching volume 7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:57:42 user nova-compute[75206]: INFO nova.virt.block_device [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Attempting to driver detach volume 7cebc9d1-065e-4582-97cc-992a86558855 from mountpoint /dev/vdb
Nov 29 21:57:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Attempting to detach device vdb from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:42 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:42 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:57:42 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:42 user nova-compute[75206]:   <serial>7cebc9d1-065e-4582-97cc-992a86558855</serial>
Nov 29 21:57:42 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 21:57:42 user nova-compute[75206]: </disk>
Nov 29 21:57:42 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully detached device vdb from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the persistent domain config.
Nov 29 21:57:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:42 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:42 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:57:42 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:42 user nova-compute[75206]:   <serial>7cebc9d1-065e-4582-97cc-992a86558855</serial>
Nov 29 21:57:42 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 21:57:42 user nova-compute[75206]: </disk>
Nov 29 21:57:42 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:57:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:46 user nova-compute[75206]: INFO nova.compute.manager [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Detaching volume 93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:57:46 user nova-compute[75206]: INFO nova.virt.block_device [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Attempting to driver detach volume 93ded810-c10f-48a3-9277-ed738d710552 from mountpoint /dev/vdb
Nov 29 21:57:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Attempting to detach device vdb from instance a0f802b4-01a1-4f73-9045-2c775637d75d from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:57:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:46 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:46 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:57:46 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:46 user nova-compute[75206]:   <serial>93ded810-c10f-48a3-9277-ed738d710552</serial>
Nov 29 21:57:46 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:57:46 user nova-compute[75206]: </disk>
Nov 29 21:57:46 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:46 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Successfully detached device vdb from instance a0f802b4-01a1-4f73-9045-2c775637d75d from the persistent domain config.
Nov 29 21:57:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0f802b4-01a1-4f73-9045-2c775637d75d from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:57:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:46 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:46 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 21:57:46 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:46 user nova-compute[75206]:   <serial>93ded810-c10f-48a3-9277-ed738d710552</serial>
Nov 29 21:57:46 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:57:46 user nova-compute[75206]: </disk>
Nov 29 21:57:46 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:57:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing instance network info cache due to event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updated VIF entry in instance network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG nova.network.neutron [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a11d3e10-4632-481d-91e1-a121dd530923 req-c8e2e7fc-6593-4dd5-be94-d5be4f68cabe service nova] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:57:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:57:55 user nova-compute[75206]: INFO nova.compute.manager [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Detaching volume 45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:57:55 user nova-compute[75206]: INFO nova.virt.block_device [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Attempting to driver detach volume 45080753-5f3b-4a8a-a1b3-1c62da12f31f from mountpoint /dev/vdb
Nov 29 21:57:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Attempting to detach device vdb from instance c7629b50-8d89-407c-b868-d265a029bf32 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:57:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:56 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:56 user nova-compute[75206]:   <source dev="/dev/sdf"/>
Nov 29 21:57:56 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:56 user nova-compute[75206]:   <serial>45080753-5f3b-4a8a-a1b3-1c62da12f31f</serial>
Nov 29 21:57:56 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 21:57:56 user nova-compute[75206]: </disk>
Nov 29 21:57:56 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully detached device vdb from instance c7629b50-8d89-407c-b868-d265a029bf32 from the persistent domain config.
Nov 29 21:57:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7629b50-8d89-407c-b868-d265a029bf32 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:57:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:57:56 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:57:56 user nova-compute[75206]:   <source dev="/dev/sdf"/>
Nov 29 21:57:56 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:57:56 user nova-compute[75206]:   <serial>45080753-5f3b-4a8a-a1b3-1c62da12f31f</serial>
Nov 29 21:57:56 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 21:57:56 user nova-compute[75206]: </disk>
Nov 29 21:57:56 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:57:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing instance network info cache due to event network-changed-aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] Acquiring lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] Acquired lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Refreshing network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updated VIF entry in instance network info cache for port aa60ee0a-b766-405f-a218-28a936489eb9. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [{"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e0f7e96f-6bee-4603-b559-6fc11d699f73 req-67971868-f4c3-4713-b0ca-b3bac1cd3d60 service nova] Releasing lock "refresh_cache-c7629b50-8d89-407c-b868-d265a029bf32" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:57:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:02 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 39f1132e-912d-455d-8686-6bdaf870da24 is timed out.
Nov 29 21:58:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully detached device vdb from instance 39f1132e-912d-455d-8686-6bdaf870da24 from the live domain config.
Nov 29 21:58:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kGEnlbiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:58:02 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a70d97-24ba-4272-82b5-fe95cbad49fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:58:02 user nova-compute[75206]: No targets found.
Nov 29 21:58:02 user nova-compute[75206]: iSNS:
Nov 29 21:58:02 user nova-compute[75206]: No targets found.
Nov 29 21:58:02 user nova-compute[75206]: STATIC:
Nov 29 21:58:02 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:58:02 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:02 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:02 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:58:02 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:02 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:02 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855
Nov 29 21:58:02 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:02 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:02 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:58:02 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:02 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:02 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:58:02 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:02 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:02 user nova-compute[75206]: FIRMWARE:
Nov 29 21:58:02 user nova-compute[75206]: No targets found.
Nov 29 21:58:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:58:02 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:58:02 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2d0e04-938d-44e4-b0e3-63db8838d152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e907a47-ad92-4d7f-a094-92167c2b5f37]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:02 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c80c48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1f81e-d3eb-4814-9dbe-27be9a9607bf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.041s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd7cb65-956d-4498-8986-627f8d88405f]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd235d-af5f-4bb1-8f61-5ec5462810f7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85556aaa-326e-46d5-98e9-648ac7113b98]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b2eb6a-a5b1-4db7-b14e-3be1ccc0da3f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbca918-84d4-4615-a0a6-97dfcfa28e57]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260]
Nov 29 21:58:03 user nova-compute[75206]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855, portal: 172.16.0.220,3260] successful.
Nov 29 21:58:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cebc9d1-065e-4582-97cc-992a86558855 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54144b-2fa9-43bd-ba13-6fa7078fff2c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== disconnect_volume: return (346ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:58:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:58:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'flavor' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9c7833b8-32fe-4a7f-956c-4fd1ddbe68b1 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:06 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0f802b4-01a1-4f73-9045-2c775637d75d is timed out.
Nov 29 21:58:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Successfully detached device vdb from instance a0f802b4-01a1-4f73-9045-2c775637d75d from the live domain config.
Nov 29 21:58:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqCGAHEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:58:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88db633-673b-49d0-8e05-79cf95cc6764]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:58:06 user nova-compute[75206]: No targets found.
Nov 29 21:58:06 user nova-compute[75206]: iSNS:
Nov 29 21:58:06 user nova-compute[75206]: No targets found.
Nov 29 21:58:06 user nova-compute[75206]: STATIC:
Nov 29 21:58:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:58:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:58:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:58:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:06 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552
Nov 29 21:58:06 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:06 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:06 user nova-compute[75206]: FIRMWARE:
Nov 29 21:58:06 user nova-compute[75206]: No targets found.
Nov 29 21:58:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:58:06 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:58:06 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df823ec7-cdb8-492a-9bb5-4b1ec8b40861]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbdd7aa-0f7c-404d-936d-3f2c87f82478]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:06 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81ec670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3bbb6a-66b2-4bb0-a3e1-7ae9c3d968b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d3e860-5604-42d9-b7ac-0b0de279fb94]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90832118-c38e-415c-8dac-ea055f5dc3c7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1217066-9fb8-4653-a3e8-332b2a128d4d]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589c6e4-096d-4bb7-872d-fe12998dd25c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc59ff84-119f-4694-a0c7-5c4193695240]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260]
Nov 29 21:58:07 user nova-compute[75206]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552, portal: 172.16.0.220,3260] successful.
Nov 29 21:58:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93ded810-c10f-48a3-9277-ed738d710552 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3202a1a6-12f8-4018-960c-c7f9dd63e72b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] <== disconnect_volume: return (338ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:58:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:08 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'flavor' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6c7585-befd-4482-bd42-dc81f4eb2aa5 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.046s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7629b50-8d89-407c-b868-d265a029bf32 is timed out.
Nov 29 21:58:16 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully detached device vdb from instance c7629b50-8d89-407c-b868-d265a029bf32 from the live domain config.
Nov 29 21:58:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSkeoxLC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:58:16 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0cf4a6-fff4-4d10-b2df-758283a5f1cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:58:16 user nova-compute[75206]: No targets found.
Nov 29 21:58:16 user nova-compute[75206]: iSNS:
Nov 29 21:58:16 user nova-compute[75206]: No targets found.
Nov 29 21:58:16 user nova-compute[75206]: STATIC:
Nov 29 21:58:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f
Nov 29 21:58:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:58:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:16 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:58:16 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:58:16 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:58:16 user nova-compute[75206]: FIRMWARE:
Nov 29 21:58:16 user nova-compute[75206]: No targets found.
Nov 29 21:58:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:58:16 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:58:16 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25280a8-fb82-445c-88fb-5d529a0d8676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a536d-f209-493f-9348-668548865903]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:16 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:16 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:16 user nova-compute[75206]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f (non-flash)
Nov 29 21:58:16 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c823e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f'): ({'sdf'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Removing single pathed devices sdf {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd32373-95ab-4165-a004-fb57c08c1cfe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044d4d8-fe8f-4efa-8e9e-ba4d2a89f566]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flushing IO for device /dev/sdf {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1abaf49-9af4-4f9e-8178-3d9290c24c5a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a200a8-76c1-4e25-8637-4ac684ed7f7f]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d60d9-ff05-43ad-84e9-72ac315e5575]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca332a-8b86-42af-9c65-65b052f02f15]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260]
Nov 29 21:58:16 user nova-compute[75206]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f, portal: 172.16.0.220,3260] successful.
Nov 29 21:58:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45080753-5f3b-4a8a-a1b3-1c62da12f31f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[945fb25d-baf5-4e21-bfd2-08d73887c049]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== disconnect_volume: return (323ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:58:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:58:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG nova.objects.instance [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-62108e5b-26d5-4266-9762-3168522e8dd0 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.523s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing instance network info cache due to event network-changed-927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] Acquiring lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] Acquired lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:58:20 user nova-compute[75206]: DEBUG nova.network.neutron [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Refreshing network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:21 user nova-compute[75206]: INFO nova.compute.manager [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Terminating instance
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-unplugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] No waiting events found dispatching network-vif-unplugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-dac4ef1d-4406-4648-b8a8-28657fa34302 req-40fef8ea-6049-4e8e-850f-c2751b7dd6b4 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-unplugged-927c8a91-a743-43cf-ad22-5ff7b10f329d for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updated VIF entry in instance network info cache for port 927c8a91-a743-43cf-ad22-5ff7b10f329d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating instance_info_cache with network_info: [{"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e97b24cd-039e-4028-ba9b-81244a223a68 req-eee29284-ec6e-454f-85c2-230f82ac163f service nova] Releasing lock "refresh_cache-bd696537-2a16-49bf-b4aa-f3bb98ec609f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:58:21 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Instance destroyed successfully.
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.objects.instance [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lazy-loading 'resources' on Instance uuid bd696537-2a16-49bf-b4aa-f3bb98ec609f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286299125',display_name='tempest-TestStampPattern-server-1286299125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286299125',id=23,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBWoftkE0LAe/fj2mMNnF1xWuBnK3XqEOGvtjtdlrZ6zc7enXQOYq6FQUD1q0Qwl524qTXeyLl3ZWdQXuWDZl7jZFoOC6pfu6dWSrd5TlLCw4geEdKWs+ewF7zbFMsKFA==',key_name='tempest-TestStampPattern-579049816',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:51:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='049af7fc294f49358608d0ab6a9b8d4f',ramdisk_id='',reservation_id='r-goafpq2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1622973448',owner_user_name='tempest-TestStampPattern-1622973448-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:54:18Z,user_data=None,user_id='e74a3cb54432457683dd38e8363528e7',uuid=bd696537-2a16-49bf-b4aa-f3bb98ec609f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converting VIF {"id": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "address": "fa:16:3e:9a:d9:7c", "network": {"id": "f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8", "bridge": "br-int", "label": "tempest-TestStampPattern-45162912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "049af7fc294f49358608d0ab6a9b8d4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927c8a91-a7", "ovs_interfaceid": "927c8a91-a743-43cf-ad22-5ff7b10f329d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG os_vif [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap927c8a91-a7, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fad85d6f-2a60-41d0-a54e-42af368de3e4) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:21 user nova-compute[75206]: INFO os_vif [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d9:7c,bridge_name='br-int',has_traffic_filtering=True,id=927c8a91-a743-43cf-ad22-5ff7b10f329d,network=Network(f9c3a6cf-bfff-4324-a99f-d294bf6aa8b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927c8a91-a7')
Nov 29 21:58:21 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Deleting instance files /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f_del
Nov 29 21:58:21 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Deletion of /opt/stack/data/nova/instances/bd696537-2a16-49bf-b4aa-f3bb98ec609f_del complete
Nov 29 21:58:22 user nova-compute[75206]: INFO nova.compute.manager [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 21:58:22 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:22 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Took 0.38 seconds to deallocate network for instance.
Nov 29 21:58:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:22 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Deleted allocations for instance bd696537-2a16-49bf-b4aa-f3bb98ec609f
Nov 29 21:58:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-200060b3-fcc1-442d-8d62-727fcf074f84 tempest-TestStampPattern-1622973448 tempest-TestStampPattern-1622973448-project-member] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-49f7d715-f7f4-4f5c-ab9c-dcea2e2662d9 req-6702081b-0228-4ec1-b5fb-24d7b579db92 service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-deleted-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] Acquiring lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] Lock "bd696537-2a16-49bf-b4aa-f3bb98ec609f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] No waiting events found dispatching network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:23 user nova-compute[75206]: WARNING nova.compute.manager [req-c9ee3d3b-eca2-466d-b4d6-32f754423fb3 req-c971191f-01e1-42ba-a83c-b0bb2265dd6d service nova] [instance: bd696537-2a16-49bf-b4aa-f3bb98ec609f] Received unexpected event network-vif-plugged-927c8a91-a743-43cf-ad22-5ff7b10f329d for instance with vm_state deleted and task_state None.
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-changed-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Refreshing instance network info cache due to event network-changed-e08bd634-f27a-458e-a48b-21761864a105. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] Acquiring lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] Acquired lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Refreshing network info cache for port e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updated VIF entry in instance network info cache for port e08bd634-f27a-458e-a48b-21761864a105. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updating instance_info_cache with network_info: [{"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4829526e-9d4e-459c-b34b-cde0a6c068a5 req-ee582416-92ca-45f5-a7b1-2b5e2ca656f0 service nova] Releasing lock "refresh_cache-25604878-4b0e-406f-bdf0-50b72f9ee117" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:28 user nova-compute[75206]: INFO nova.compute.manager [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Attaching volume 188b90df-1012-4701-9d9e-4c4f23b71b25 to /dev/vdb
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fc3db-b2ae-40e1-bd62-f7f9726b48f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd3828b-4324-4519-8c9d-949623490859]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b85b1f3-572e-4e4c-8d71-6e2007271b9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[968fd94f-c64a-4b01-a0aa-b0fc68e513b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:58:28 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cd32fb-d237-425b-b120-e208508141c5]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updating existing volume attachment record: 21b13d11-e730-4a31-87a1-eaad6583d8d6 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:58:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:58:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7295MB free_disk=24.832664489746094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 93c88682-7fb9-437f-9023-dc7dc9490205 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance a0f802b4-01a1-4f73-9045-2c775637d75d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 39f1132e-912d-455d-8686-6bdaf870da24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c7629b50-8d89-407c-b868-d265a029bf32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 25604878-4b0e-406f-bdf0-50b72f9ee117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:58:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:58:30 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:30 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:58:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:32 user nova-compute[75206]: INFO nova.compute.manager [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Terminating instance
Nov 29 21:58:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-2ad457b7-148a-42e8-92fd-93938b32074f req-43163fcf-9d89-43ac-b562-0d09e9ef4313 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-unplugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:58:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Instance destroyed successfully.
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'resources' on Instance uuid 39f1132e-912d-455d-8686-6bdaf870da24 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-410845633',display_name='tempest-ServerActionsTestOtherA-server-259662229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-410845633',id=26,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE9RmoogoYYWskEcnODzV1YZmECrkzhiTRCQE7Cm3j1IVAsp9KkkJIu80jSc0tPIGY7CkY7y2ZsZ3u1LNJAY1eGcoXroE8bXiWs0CslYYpt1fvNwWmZ+DNI3waGhiODBA==',key_name='tempest-keypair-1794359477',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-wwqcwyzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=39f1132e-912d-455d-8686-6bdaf870da24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "address": "fa:16:3e:6d:10:cd", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3b1902e-6a", "ovs_interfaceid": "a3b1902e-6a42-4849-8d5c-0567d9601b8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG os_vif [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3b1902e-6a, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98d802d7-1974-4a2d-aa48-f3937e9691ef) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:33 user nova-compute[75206]: INFO os_vif [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:10:cd,bridge_name='br-int',has_traffic_filtering=True,id=a3b1902e-6a42-4849-8d5c-0567d9601b8f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3b1902e-6a')
Nov 29 21:58:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Deleting instance files /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24_del
Nov 29 21:58:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Deletion of /opt/stack/data/nova/instances/39f1132e-912d-455d-8686-6bdaf870da24_del complete
Nov 29 21:58:33 user nova-compute[75206]: INFO nova.compute.manager [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:58:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [{"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-a0f802b4-01a1-4f73-9045-2c775637d75d" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:34 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Took 0.97 seconds to deallocate network for instance.
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-8f56643f-430d-42bb-bd65-c648578a39df req-c7bec796-17ca-426d-8432-0ccffd1529c7 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-deleted-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:34 user nova-compute[75206]: INFO nova.compute.manager [req-8f56643f-430d-42bb-bd65-c648578a39df req-c7bec796-17ca-426d-8432-0ccffd1529c7 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Neutron deleted interface a3b1902e-6a42-4849-8d5c-0567d9601b8f; detaching it from the instance and deleting it from the info cache
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-8f56643f-430d-42bb-bd65-c648578a39df req-c7bec796-17ca-426d-8432-0ccffd1529c7 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-8f56643f-430d-42bb-bd65-c648578a39df req-c7bec796-17ca-426d-8432-0ccffd1529c7 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Detach interface failed, port_id=a3b1902e-6a42-4849-8d5c-0567d9601b8f, reason: Instance 39f1132e-912d-455d-8686-6bdaf870da24 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:34 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:35 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Deleted allocations for instance 39f1132e-912d-455d-8686-6bdaf870da24
Nov 29 21:58:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] Acquiring lock "39f1132e-912d-455d-8686-6bdaf870da24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] Lock "39f1132e-912d-455d-8686-6bdaf870da24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] No waiting events found dispatching network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:35 user nova-compute[75206]: WARNING nova.compute.manager [req-1aa78d8b-7092-46f8-b146-51b07cc2f781 req-5978c953-3ea7-4e93-b724-b79edb498fb8 service nova] [instance: 39f1132e-912d-455d-8686-6bdaf870da24] Received unexpected event network-vif-plugged-a3b1902e-6a42-4849-8d5c-0567d9601b8f for instance with vm_state deleted and task_state None.
Nov 29 21:58:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c02704d2-665f-45b4-ae16-56f72d87394f tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "39f1132e-912d-455d-8686-6bdaf870da24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:36 user nova-compute[75206]: INFO nova.compute.manager [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Terminating instance
Nov 29 21:58:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.compute.manager [req-f3778b7f-09b9-451e-9a67-e1387b0c19f3 req-a02d1b78-2aaa-4d06-9bef-99a1fe03a981 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-unplugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qgnjpasU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:58:37 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:58:37 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:58:37 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Instance destroyed successfully.
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.objects.instance [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lazy-loading 'resources' on Instance uuid a0f802b4-01a1-4f73-9045-2c775637d75d {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6269be-3926-4bcb-9f31-88b4a8302e73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-244463796',display_name='tempest-ServerStableDeviceRescueTest-server-244463796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-244463796',id=22,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgDfI6cOSssiguvTUo1OxD2sn9+6FgjoVcX+pNO1J+Sce/OQuUX/V7hTKuQSrJwyg2tKN+JZWZzlLODLdoe4ORW8hXUbgBPBjXT6teOPO1JnIEn5IDb4NJqCqHLzpk+tg==',key_name='tempest-keypair-121556689',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c97bf8394f8462ab3804fff32aa78d0',ramdisk_id='',reservation_id='r-rx7wd2jb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1905805476',owner_user_name='tempest-ServerStableDeviceRescueTest-1905805476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f201d8cbf844e4b6726ce9f35ca439',uuid=a0f802b4-01a1-4f73-9045-2c775637d75d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converting VIF {"id": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "address": "fa:16:3e:91:f9:e4", "network": {"id": "40d33073-4d11-4144-9e4e-fdae2d1e8d09", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1314436834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c97bf8394f8462ab3804fff32aa78d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0df5d7-9c", "ovs_interfaceid": "2d0df5d7-9c74-49f7-a2cd-dec9050dd926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_vif [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:58:37 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d0df5d7-9c, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d564cc1-00e6-417d-b6d1-39229d0eff47) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:37 user nova-compute[75206]: INFO os_vif [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f9:e4,bridge_name='br-int',has_traffic_filtering=True,id=2d0df5d7-9c74-49f7-a2cd-dec9050dd926,network=Network(40d33073-4d11-4144-9e4e-fdae2d1e8d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0df5d7-9c')
Nov 29 21:58:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Deleting instance files /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d_del
Nov 29 21:58:37 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Deletion of /opt/stack/data/nova/instances/a0f802b4-01a1-4f73-9045-2c775637d75d_del complete
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dbdb04-0e15-4ba7-908a-26d67fc85a78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25] added
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9686ba-0ba9-4e14-9356-7338cf7b117a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de7908-217f-4995-ad77-82878c1a6acf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qgnjpasU {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qgnjpasU" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4119b607-fc95-44a6-abd2-1c159edf4e69]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qgnjpasU'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: INFO nova.compute.manager [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb85b77-2786-40c3-8b67-5eaec5517314]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848e48f-33b7-4810-9af7-1094f2edfef9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6bb24d-00c2-4bf3-8a30-6e2165a0af8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260]
Nov 29 21:58:37 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260] successful.
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc06506-a04c-4bd4-ae36-aa9b4e1204da]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d7ebec-69da-4f4f-b28e-d75a47b2e08c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d30c39-1568-42e2-bef6-5fbc87b19e27 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)
Nov 29 21:58:37 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:58:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbf995b-a9de-41b6-95a0-004d62b9f0be]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qgnjpasU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:38 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Took 0.86 seconds to deallocate network for instance.
Nov 29 21:58:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-950b957d-7b98-44ca-84c9-c7885845ebc4 req-cd79f0d2-6764-409b-901d-2d39d90f22a0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-deleted-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23937326438616461', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937326438616461', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:58:39 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:58:39 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:58:39 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:58:39 user nova-compute[75206]:   <serial>188b90df-1012-4701-9d9e-4c4f23b71b25</serial>
Nov 29 21:58:39 user nova-compute[75206]: </disk>
Nov 29 21:58:39 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:39 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Deleted allocations for instance a0f802b4-01a1-4f73-9045-2c775637d75d
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-76282077-5f51-4ab1-b01c-46b6d9ab86a3 tempest-ServerStableDeviceRescueTest-1905805476 tempest-ServerStableDeviceRescueTest-1905805476-project-member] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] Acquiring lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] Lock "a0f802b4-01a1-4f73-9045-2c775637d75d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] No waiting events found dispatching network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:39 user nova-compute[75206]: WARNING nova.compute.manager [req-6408d449-8df1-47a4-a2d4-1e2ab6afceba req-5c8f3960-0553-40cf-9d9a-f02a5bab79d0 service nova] [instance: a0f802b4-01a1-4f73-9045-2c775637d75d] Received unexpected event network-vif-plugged-2d0df5d7-9c74-49f7-a2cd-dec9050dd926 for instance with vm_state deleted and task_state None.
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] No VIF found with MAC fa:16:3e:a2:07:d5, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:58:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a92fc981-1975-46dd-ba85-537fc201ba6b tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.061s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:40 user nova-compute[75206]: INFO nova.compute.manager [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Detaching volume 188b90df-1012-4701-9d9e-4c4f23b71b25
Nov 29 21:58:40 user nova-compute[75206]: INFO nova.virt.block_device [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Attempting to driver detach volume 188b90df-1012-4701-9d9e-4c4f23b71b25 from mountpoint /dev/vdb
Nov 29 21:58:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Attempting to detach device vdb from instance 25604878-4b0e-406f-bdf0-50b72f9ee117 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:58:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:58:40 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:58:40 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:58:40 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:58:40 user nova-compute[75206]:   <serial>188b90df-1012-4701-9d9e-4c4f23b71b25</serial>
Nov 29 21:58:40 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:58:40 user nova-compute[75206]: </disk>
Nov 29 21:58:40 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:58:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance 25604878-4b0e-406f-bdf0-50b72f9ee117 from the persistent domain config.
Nov 29 21:58:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25604878-4b0e-406f-bdf0-50b72f9ee117 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:58:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:58:40 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:58:40 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 21:58:40 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:58:40 user nova-compute[75206]:   <serial>188b90df-1012-4701-9d9e-4c4f23b71b25</serial>
Nov 29 21:58:40 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:58:40 user nova-compute[75206]: </disk>
Nov 29 21:58:40 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:58:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:58:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:58:47 user nova-compute[75206]: INFO nova.compute.claims [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Claim successful on node user
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:58:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.policy [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79424ddb3af406d9ed8a1626a8f03ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffcb36d26c41cd99ccb16570f285dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:58:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Creating image(s)
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk 1073741824" returned: 0 in 0.072s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Successfully created port: be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Cannot resize image /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Ensure instance console log exists: /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Successfully updated port: be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-changed-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Refreshing instance network info cache due to event network-changed-be750adb-f6c6-43f9-8ccd-f0c3879add04. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:58:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] Acquiring lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updating instance_info_cache with network_info: [{"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Instance network_info: |[{"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] Acquired lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Refreshing network info cache for port be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Start _get_guest_xml network_info=[{"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:58:49 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:58:49 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1714751608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1714751608',id=32,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-kggoinhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:58:48Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=f5314b05-629e-4844-9496-f8e23c5c2e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid f5314b05-629e-4844-9496-f8e23c5c2e01 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:58:49 user nova-compute[75206]:   <uuid>f5314b05-629e-4844-9496-f8e23c5c2e01</uuid>
Nov 29 21:58:49 user nova-compute[75206]:   <name>instance-00000020</name>
Nov 29 21:58:49 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:58:49 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:58:49 user nova-compute[75206]:   <metadata>
Nov 29 21:58:49 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:58:49 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1714751608</nova:name>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:58:49</nova:creationTime>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:58:49 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:58:49 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:owner>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 21:58:49 user nova-compute[75206]:       </nova:owner>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:58:49 user nova-compute[75206]:       <nova:ports>
Nov 29 21:58:49 user nova-compute[75206]:         <nova:port uuid="be750adb-f6c6-43f9-8ccd-f0c3879add04">
Nov 29 21:58:49 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 21:58:49 user nova-compute[75206]:         </nova:port>
Nov 29 21:58:49 user nova-compute[75206]:       </nova:ports>
Nov 29 21:58:49 user nova-compute[75206]:     </nova:instance>
Nov 29 21:58:49 user nova-compute[75206]:   </metadata>
Nov 29 21:58:49 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:58:49 user nova-compute[75206]:     <system>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="serial">f5314b05-629e-4844-9496-f8e23c5c2e01</entry>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="uuid">f5314b05-629e-4844-9496-f8e23c5c2e01</entry>
Nov 29 21:58:49 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:58:49 user nova-compute[75206]:     </system>
Nov 29 21:58:49 user nova-compute[75206]:   </sysinfo>
Nov 29 21:58:49 user nova-compute[75206]:   <os>
Nov 29 21:58:49 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:58:49 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:58:49 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:58:49 user nova-compute[75206]:   </os>
Nov 29 21:58:49 user nova-compute[75206]:   <features>
Nov 29 21:58:49 user nova-compute[75206]:     <acpi/>
Nov 29 21:58:49 user nova-compute[75206]:     <apic/>
Nov 29 21:58:49 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:58:49 user nova-compute[75206]:   </features>
Nov 29 21:58:49 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:58:49 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:58:49 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:58:49 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:58:49 user nova-compute[75206]:   </clock>
Nov 29 21:58:49 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:58:49 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:58:49 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:58:49 user nova-compute[75206]:   </cpu>
Nov 29 21:58:49 user nova-compute[75206]:   <devices>
Nov 29 21:58:49 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:58:49 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:58:49 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk"/>
Nov 29 21:58:49 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:58:49 user nova-compute[75206]:     </disk>
Nov 29 21:58:49 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:58:49 user nova-compute[75206]:       <mac address="fa:16:3e:ac:4c:13"/>
Nov 29 21:58:49 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:58:49 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:58:49 user nova-compute[75206]:       <target dev="tapbe750adb-f6"/>
Nov 29 21:58:49 user nova-compute[75206]:     </interface>
Nov 29 21:58:49 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:58:49 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/console.log" append="off"/>
Nov 29 21:58:49 user nova-compute[75206]:     </serial>
Nov 29 21:58:49 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:58:49 user nova-compute[75206]:     <video>
Nov 29 21:58:49 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:58:49 user nova-compute[75206]:     </video>
Nov 29 21:58:49 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:58:49 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:58:49 user nova-compute[75206]:     </rng>
Nov 29 21:58:49 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:58:49 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:58:49 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:58:49 user nova-compute[75206]:     </memballoon>
Nov 29 21:58:49 user nova-compute[75206]:   </devices>
Nov 29 21:58:49 user nova-compute[75206]: </domain>
Nov 29 21:58:49 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1714751608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1714751608',id=32,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-kggoinhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:58:48Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=f5314b05-629e-4844-9496-f8e23c5c2e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG os_vif [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a35cb3be-281a-5d7c-9b42-6dbc3a0a374e', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe750adb-f6, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe750adb-f6, col_values=(('qos', UUID('41b4757a-c93f-46aa-849c-7f6a81b77e05')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe750adb-f6, col_values=(('external_ids', {'iface-id': 'be750adb-f6c6-43f9-8ccd-f0c3879add04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:4c:13', 'vm-uuid': 'f5314b05-629e-4844-9496-f8e23c5c2e01'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:49 user nova-compute[75206]: INFO os_vif [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6')
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:ac:4c:13, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updated VIF entry in instance network info cache for port be750adb-f6c6-43f9-8ccd-f0c3879add04. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updating instance_info_cache with network_info: [{"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3ff3b02-9649-40f4-abe4-a9f5f645a8ce req-b0eb07e6-e1d5-4a2b-9cd9-5a6acc0b4ea1 service nova] Releasing lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] No waiting events found dispatching network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:51 user nova-compute[75206]: WARNING nova.compute.manager [req-640e2c53-0708-46a1-9719-e6a44c554a9b req-027ba4be-731e-4f2e-8312-65bb63b6287f service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received unexpected event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 for instance with vm_state building and task_state spawning.
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:51 user nova-compute[75206]: INFO nova.compute.manager [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Terminating instance
Nov 29 21:58:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-unplugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] No waiting events found dispatching network-vif-unplugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-3cec0cda-025a-4089-bcfc-28cab62e8d90 req-36de0ea1-30fa-4034-ac98-63e5886c8464 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-unplugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:52 user nova-compute[75206]: INFO nova.compute.manager [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Terminating instance
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Instance destroyed successfully.
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lazy-loading 'resources' on Instance uuid 93c88682-7fb9-437f-9023-dc7dc9490205 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-747930159',display_name='tempest-ServersNegativeTestJSON-server-747930159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-747930159',id=17,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a22aa096e084ddda505cd9dbf6dac1c',ramdisk_id='',reservation_id='r-vysplhc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1799503281',owner_user_name='tempest-ServersNegativeTestJSON-1799503281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:50:04Z,user_data=None,user_id='6f1e0d3414724008be536b7ccf389d41',uuid=93c88682-7fb9-437f-9023-dc7dc9490205,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converting VIF {"id": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "address": "fa:16:3e:6e:ca:35", "network": {"id": "e1595b6f-732b-48b8-b3d4-49c2aaa73cc5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-902704548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a22aa096e084ddda505cd9dbf6dac1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11305df-ab", "ovs_interfaceid": "c11305df-ab89-4dbd-9a00-bd05e6bc85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG os_vif [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc11305df-ab, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8822234-a3e7-42b4-9bed-466d602da443) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:52 user nova-compute[75206]: INFO os_vif [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:ca:35,bridge_name='br-int',has_traffic_filtering=True,id=c11305df-ab89-4dbd-9a00-bd05e6bc85bc,network=Network(e1595b6f-732b-48b8-b3d4-49c2aaa73cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11305df-ab')
Nov 29 21:58:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Deleting instance files /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205_del
Nov 29 21:58:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Deletion of /opt/stack/data/nova/instances/93c88682-7fb9-437f-9023-dc7dc9490205_del complete
Nov 29 21:58:52 user nova-compute[75206]: INFO nova.compute.manager [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 29 21:58:52 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:58:52 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Instance destroyed successfully.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'resources' on Instance uuid c7629b50-8d89-407c-b868-d265a029bf32 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1507297911',display_name='tempest-TestMinimumBasicScenario-server-1507297911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1507297911',id=28,image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuO9sbzVMS/vuO0Fn7Kdj9MOc84bXkJ5kPQSV1+Pg5nRuCViEVM2Udp66v/Dnnfb+8f/ezO6yl0ggewPLiX8aNOpwpEhsXfy0oWii+TBbr8zcRHf3a87rZ3osU5ytBEYA==',key_name='tempest-TestMinimumBasicScenario-606614370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-22737fj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a27033a8-5eb8-4ee1-a037-38ac6f138341',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:11Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=c7629b50-8d89-407c-b868-d265a029bf32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "aa60ee0a-b766-405f-a218-28a936489eb9", "address": "fa:16:3e:53:72:a6", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa60ee0a-b7", "ovs_interfaceid": "aa60ee0a-b766-405f-a218-28a936489eb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG os_vif [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa60ee0a-b7, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e07e30ac-166b-4d3f-922f-67508ee54d04) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:53 user nova-compute[75206]: INFO os_vif [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=aa60ee0a-b766-405f-a218-28a936489eb9,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa60ee0a-b7')
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Deleting instance files /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32_del
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Deletion of /opt/stack/data/nova/instances/c7629b50-8d89-407c-b868-d265a029bf32_del complete
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.compute.manager [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] No waiting events found dispatching network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:53 user nova-compute[75206]: WARNING nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received unexpected event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 for instance with vm_state building and task_state spawning.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-unplugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Acquiring lock "c7629b50-8d89-407c-b868-d265a029bf32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] Lock "c7629b50-8d89-407c-b868-d265a029bf32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] No waiting events found dispatching network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:53 user nova-compute[75206]: WARNING nova.compute.manager [req-3e236fd2-f2a9-4191-8adc-73b21ee205c5 req-b07ab891-8ad6-4d84-bdf9-e3f80c02c9e4 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received unexpected event network-vif-plugged-aa60ee0a-b766-405f-a218-28a936489eb9 for instance with vm_state active and task_state deleting.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Took 0.90 seconds to deallocate network for instance.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Instance spawned successfully.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:58:53 user nova-compute[75206]: INFO nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:53 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:54 user nova-compute[75206]: INFO nova.compute.manager [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Took 7.02 seconds to build instance.
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f279552-d3c1-4f53-983b-c8ac60b1840d tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.156s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:54 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Deleted allocations for instance 93c88682-7fb9-437f-9023-dc7dc9490205
Nov 29 21:58:54 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:58:54 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Took 0.93 seconds to deallocate network for instance.
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7aa59a16-9743-4c89-8b20-28e28c6805f2 tempest-ServersNegativeTestJSON-1799503281 tempest-ServersNegativeTestJSON-1799503281-project-member] Lock "93c88682-7fb9-437f-9023-dc7dc9490205" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] Acquiring lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] Lock "93c88682-7fb9-437f-9023-dc7dc9490205-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] No waiting events found dispatching network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:58:54 user nova-compute[75206]: WARNING nova.compute.manager [req-2b8ddc9a-9580-4289-afe1-ff06663a2cdc req-e98a3c6d-1d89-4bd5-acf8-270d80453250 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received unexpected event network-vif-plugged-c11305df-ab89-4dbd-9a00-bd05e6bc85bc for instance with vm_state deleted and task_state None.
Nov 29 21:58:54 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:54 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Deleted allocations for instance c7629b50-8d89-407c-b868-d265a029bf32
Nov 29 21:58:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2bfcb186-9da9-4c17-92e8-b193d9390be8 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "c7629b50-8d89-407c-b868-d265a029bf32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:58:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-33e2b41a-39cf-4b13-9bfa-174076a7a243 req-814e37db-170d-40fa-9ce6-318071848427 service nova] [instance: 93c88682-7fb9-437f-9023-dc7dc9490205] Received event network-vif-deleted-c11305df-ab89-4dbd-9a00-bd05e6bc85bc {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-33e2b41a-39cf-4b13-9bfa-174076a7a243 req-814e37db-170d-40fa-9ce6-318071848427 service nova] [instance: c7629b50-8d89-407c-b868-d265a029bf32] Received event network-vif-deleted-aa60ee0a-b766-405f-a218-28a936489eb9 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:58:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:58:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25604878-4b0e-406f-bdf0-50b72f9ee117 is timed out.
Nov 29 21:59:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully detached device vdb from instance 25604878-4b0e-406f-bdf0-50b72f9ee117 from the live domain config.
Nov 29 21:59:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qgnjpasU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:59:01 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482ed85-4211-4a33-9063-35dd6311c2c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:59:01 user nova-compute[75206]: No targets found.
Nov 29 21:59:01 user nova-compute[75206]: iSNS:
Nov 29 21:59:01 user nova-compute[75206]: No targets found.
Nov 29 21:59:01 user nova-compute[75206]: STATIC:
Nov 29 21:59:01 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25
Nov 29 21:59:01 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:59:01 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:59:01 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:59:01 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:59:01 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:59:01 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:59:01 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:59:01 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:59:01 user nova-compute[75206]: FIRMWARE:
Nov 29 21:59:01 user nova-compute[75206]: No targets found.
Nov 29 21:59:01 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:59:01 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:59:01 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644ce7c-d216-46c8-9b02-885d738fd446]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a3d583-855d-40e2-bdea-901e0c5ef9d6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:59:01 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:59:01 user nova-compute[75206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)
Nov 29 21:59:01 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:59:01 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:59:01 user nova-compute[75206]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 (non-flash)
Nov 29 21:59:01 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8109240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bd7d4b-98a4-47eb-9970-bb17690445c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5330422-15a4-4ebe-970f-61aa2569398a]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d231e7-4cdc-42c1-b165-487fcff9472b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47212b-429a-4411-9489-b8724fa566a1]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c515509-b134-482d-b7ab-5db5dbe62707]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49b282-83cb-48ef-a49a-66aa22f1a5db]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260]
Nov 29 21:59:01 user nova-compute[75206]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25, portal: 172.16.0.220,3260] successful.
Nov 29 21:59:01 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:188b90df-1012-4701-9d9e-4c4f23b71b25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3ad65-2161-4536-807a-d3408ee0a68b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] <== disconnect_volume: return (277ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:59:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:59:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:08 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'flavor' on Instance uuid 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c8b8ec98-dfe2-4a5c-ae83-48b897e921c1 tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.591s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:59:11 user nova-compute[75206]: INFO nova.compute.claims [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Claim successful on node user
Nov 29 21:59:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:59:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.policy [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93bf49b7d7334849ae0ed9632fa3c508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e3eac3db4a4ca09a436c696b50ada2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:59:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Creating image(s)
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk 1073741824" returned: 0 in 0.054s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Successfully created port: 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Cannot resize image /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Ensure instance console log exists: /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Successfully updated port: 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing instance network info cache due to event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance network_info: |[{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start _get_guest_xml network_info=[{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:59:14 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:14 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-555833462',display_name='tempest-ServerRescueNegativeTestJSON-server-555833462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-555833462',id=33,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoboCZMxVTfgRk1v85pAzAHlE0D3c1Dnq8H8Pq9WEa4pe9EM9RAkjx74BBBscZynnADJM80ke9KGFTSgcS9/aiUHbEU/M16jv/uWrOJ9aAuGvRkuhzKx0IL3g53dhU2ZA==',key_name='tempest-keypair-39788666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-hsyq27bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=21ba84fd-5988-4a9c-8b2b-b710981d5be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:59:14 user nova-compute[75206]:   <uuid>21ba84fd-5988-4a9c-8b2b-b710981d5be5</uuid>
Nov 29 21:59:14 user nova-compute[75206]:   <name>instance-00000021</name>
Nov 29 21:59:14 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:59:14 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:59:14 user nova-compute[75206]:   <metadata>
Nov 29 21:59:14 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:59:14 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-555833462</nova:name>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:59:14</nova:creationTime>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:59:14 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:59:14 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:owner>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 21:59:14 user nova-compute[75206]:       </nova:owner>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:59:14 user nova-compute[75206]:       <nova:ports>
Nov 29 21:59:14 user nova-compute[75206]:         <nova:port uuid="5b614235-5a18-4441-bac0-0c3573f0c014">
Nov 29 21:59:14 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 21:59:14 user nova-compute[75206]:         </nova:port>
Nov 29 21:59:14 user nova-compute[75206]:       </nova:ports>
Nov 29 21:59:14 user nova-compute[75206]:     </nova:instance>
Nov 29 21:59:14 user nova-compute[75206]:   </metadata>
Nov 29 21:59:14 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:59:14 user nova-compute[75206]:     <system>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="serial">21ba84fd-5988-4a9c-8b2b-b710981d5be5</entry>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="uuid">21ba84fd-5988-4a9c-8b2b-b710981d5be5</entry>
Nov 29 21:59:14 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:59:14 user nova-compute[75206]:     </system>
Nov 29 21:59:14 user nova-compute[75206]:   </sysinfo>
Nov 29 21:59:14 user nova-compute[75206]:   <os>
Nov 29 21:59:14 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:59:14 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:59:14 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:59:14 user nova-compute[75206]:   </os>
Nov 29 21:59:14 user nova-compute[75206]:   <features>
Nov 29 21:59:14 user nova-compute[75206]:     <acpi/>
Nov 29 21:59:14 user nova-compute[75206]:     <apic/>
Nov 29 21:59:14 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:59:14 user nova-compute[75206]:   </features>
Nov 29 21:59:14 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:59:14 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:59:14 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:59:14 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:59:14 user nova-compute[75206]:   </clock>
Nov 29 21:59:14 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:59:14 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:59:14 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:59:14 user nova-compute[75206]:   </cpu>
Nov 29 21:59:14 user nova-compute[75206]:   <devices>
Nov 29 21:59:14 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:59:14 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:59:14 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk"/>
Nov 29 21:59:14 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:59:14 user nova-compute[75206]:     </disk>
Nov 29 21:59:14 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:59:14 user nova-compute[75206]:       <mac address="fa:16:3e:cd:99:8d"/>
Nov 29 21:59:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:14 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:59:14 user nova-compute[75206]:       <target dev="tap5b614235-5a"/>
Nov 29 21:59:14 user nova-compute[75206]:     </interface>
Nov 29 21:59:14 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:59:14 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/console.log" append="off"/>
Nov 29 21:59:14 user nova-compute[75206]:     </serial>
Nov 29 21:59:14 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:59:14 user nova-compute[75206]:     <video>
Nov 29 21:59:14 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:14 user nova-compute[75206]:     </video>
Nov 29 21:59:14 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:59:14 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:59:14 user nova-compute[75206]:     </rng>
Nov 29 21:59:14 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:59:14 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:59:14 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:59:14 user nova-compute[75206]:     </memballoon>
Nov 29 21:59:14 user nova-compute[75206]:   </devices>
Nov 29 21:59:14 user nova-compute[75206]: </domain>
Nov 29 21:59:14 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-555833462',display_name='tempest-ServerRescueNegativeTestJSON-server-555833462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-555833462',id=33,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoboCZMxVTfgRk1v85pAzAHlE0D3c1Dnq8H8Pq9WEa4pe9EM9RAkjx74BBBscZynnADJM80ke9KGFTSgcS9/aiUHbEU/M16jv/uWrOJ9aAuGvRkuhzKx0IL3g53dhU2ZA==',key_name='tempest-keypair-39788666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-hsyq27bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=21ba84fd-5988-4a9c-8b2b-b710981d5be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG os_vif [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '368e46ac-dbca-5d03-8752-2cc1f6cd9c7c', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b614235-5a, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b614235-5a, col_values=(('qos', UUID('a62c7734-5233-4ef4-b05f-e5ddded4b0df')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b614235-5a, col_values=(('external_ids', {'iface-id': '5b614235-5a18-4441-bac0-0c3573f0c014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:99:8d', 'vm-uuid': '21ba84fd-5988-4a9c-8b2b-b710981d5be5'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:14 user nova-compute[75206]: INFO os_vif [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a')
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:cd:99:8d, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updated VIF entry in instance network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47a5baa7-8e97-433b-9ada-57ceb410f9a8 req-abca8d7d-923c-4071-8dbe-a1b0ac59cb65 service nova] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:15 user nova-compute[75206]: WARNING nova.compute.manager [req-38163292-62a9-4c77-8ebc-b094d42f613b req-0325224e-e382-48e4-8f77-c14f2e4121ae service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state building and task_state spawning.
Nov 29 21:59:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:59:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance spawned successfully.
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:17 user nova-compute[75206]: INFO nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 29 21:59:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:59:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:18 user nova-compute[75206]: WARNING nova.compute.manager [req-20462483-7a7f-44ee-974f-7bcbc5914b94 req-41b40f64-7784-4c7a-b8f3-197d037ef441 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state building and task_state spawning.
Nov 29 21:59:18 user nova-compute[75206]: INFO nova.compute.manager [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Took 6.20 seconds to build instance.
Nov 29 21:59:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9ecf7892-71de-49c7-a78b-9654d170bb13 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.302s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:29 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7838MB free_disk=24.9998779296875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 1d5f34b2-1301-4d46-9183-55c070ba28d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 25604878-4b0e-406f-bdf0-50b72f9ee117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:59:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:30 user nova-compute[75206]: INFO nova.compute.manager [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Terminating instance
Nov 29 21:59:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG nova.compute.manager [req-61cb2961-3f59-4d33-9e1c-9116358201d7 req-915a652b-c656-4d71-8c16-57ea69f7fbfe service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-unplugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:30 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Instance destroyed successfully.
Nov 29 21:59:30 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lazy-loading 'resources' on Instance uuid 1d5f34b2-1301-4d46-9183-55c070ba28d5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1888886025',display_name='tempest-ServerActionsTestOtherB-server-1888886025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1888886025',id=21,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu1FBo4WI08QlRtw3MWByg0VMRktG7X19MDOn1HTj2ZqlGP2/JhTOyL0q7zCOPRVbuxhVcfeJ3jAn7GxUPuKDidR4NraQTMdFcY/gLoNeEVUx2+FCwTwV4ZleoydMetIg==',key_name='tempest-keypair-685006476',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f2c15727dc47e19d00ff536db432df',ramdisk_id='',reservation_id='r-190rlcc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-957997184',owner_user_name='tempest-ServerActionsTestOtherB-957997184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e37b628d0f0a460aa528e4185c4b6683',uuid=1d5f34b2-1301-4d46-9183-55c070ba28d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converting VIF {"id": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "address": "fa:16:3e:2d:f2:ae", "network": {"id": "d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2127429818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f2c15727dc47e19d00ff536db432df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe76bc7-48", "ovs_interfaceid": "ebe76bc7-4889-4a62-8564-3a3cd230d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_vif [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebe76bc7-48, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45f613f8-6982-4645-9589-5b108ebbf331) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:31 user nova-compute[75206]: INFO os_vif [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:ae,bridge_name='br-int',has_traffic_filtering=True,id=ebe76bc7-4889-4a62-8564-3a3cd230d96e,network=Network(d70f8e2d-bb7b-4c9d-8c05-ddb35a1b32c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe76bc7-48')
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cNCtFRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:59:31 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45d895-f7b3-4679-8adb-daed41d79337]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:59:31 user nova-compute[75206]: No targets found.
Nov 29 21:59:31 user nova-compute[75206]: iSNS:
Nov 29 21:59:31 user nova-compute[75206]: No targets found.
Nov 29 21:59:31 user nova-compute[75206]: STATIC:
Nov 29 21:59:31 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 21:59:31 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:59:31 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:59:31 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff
Nov 29 21:59:31 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:59:31 user nova-compute[75206]:                 Iface Name: default
Nov 29 21:59:31 user nova-compute[75206]: FIRMWARE:
Nov 29 21:59:31 user nova-compute[75206]: No targets found.
Nov 29 21:59:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:59:31 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:59:31 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f6d263-6f0c-4a0a-b64e-39c88cd3c6cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e873ead-51db-4cce-8368-4dbdef90a7c8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:59:31 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:59:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 21:59:31 user nova-compute[75206]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff (non-flash)
Nov 29 21:59:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8466290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b69aa-917e-4772-958c-deb5df24ad24]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11a711-9958-4a17-9d82-eb3f5331f594]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef15f7-7381-4bf6-aeb7-f4064dc622d4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85409a56-7238-4430-bd41-e6bfe717f5db]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:31 user nova-compute[75206]: INFO nova.compute.manager [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Terminating instance
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[679e93c6-c7d3-4400-b7de-92a2d59a98e6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e1611-ff27-491a-84ca-6a4f50162d32]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260]
Nov 29 21:59:31 user nova-compute[75206]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff, portal: 172.16.0.220,3260] successful.
Nov 29 21:59:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd1ecab4-3282-4065-b907-c3d5ab205bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897a415-d496-4485-a0ab-0d834f9357f0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] <== disconnect_volume: return (356ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:59:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Deleting instance files /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_del
Nov 29 21:59:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Deletion of /opt/stack/data/nova/instances/1d5f34b2-1301-4d46-9183-55c070ba28d5_del complete
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:31 user nova-compute[75206]: INFO nova.compute.manager [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 21:59:31 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:59:31 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:59:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Instance destroyed successfully.
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lazy-loading 'resources' on Instance uuid 25604878-4b0e-406f-bdf0-50b72f9ee117 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2081985667',display_name='tempest-AttachVolumeNegativeTest-server-2081985667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2081985667',id=31,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEI54TJnPqSIZb9KKJ7/ik6++xGTmR2b7Qu0GtwztCaB/M1emjcbtvZaPY2OuZxI+C1lLIM82XdOMAaUXoBMCTw7ZS4rhCnONpJw+ni7Rex+ty7r/8W1QIEB/dCBrIZYQ==',key_name='tempest-keypair-2044573087',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:56:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e8009177c2d4cebaee3848aba1eeded',ramdisk_id='',reservation_id='r-or0losbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-330553211',owner_user_name='tempest-AttachVolumeNegativeTest-330553211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9befc13bc6ec4d6fb37d297c6927602f',uuid=25604878-4b0e-406f-bdf0-50b72f9ee117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converting VIF {"id": "e08bd634-f27a-458e-a48b-21761864a105", "address": "fa:16:3e:a2:07:d5", "network": {"id": "64093748-6735-4bf6-8b3f-9eaf69453322", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1198455877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e8009177c2d4cebaee3848aba1eeded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08bd634-f2", "ovs_interfaceid": "e08bd634-f27a-458e-a48b-21761864a105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG os_vif [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape08bd634-f2, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1eb3765-b30c-4593-8fdd-d9776dcba031) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:32 user nova-compute[75206]: INFO os_vif [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:07:d5,bridge_name='br-int',has_traffic_filtering=True,id=e08bd634-f27a-458e-a48b-21761864a105,network=Network(64093748-6735-4bf6-8b3f-9eaf69453322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08bd634-f2')
Nov 29 21:59:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Deleting instance files /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117_del
Nov 29 21:59:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Deletion of /opt/stack/data/nova/instances/25604878-4b0e-406f-bdf0-50b72f9ee117_del complete
Nov 29 21:59:32 user nova-compute[75206]: INFO nova.compute.manager [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Acquiring lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] No waiting events found dispatching network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:32 user nova-compute[75206]: WARNING nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received unexpected event network-vif-plugged-ebe76bc7-4889-4a62-8564-3a3cd230d96e for instance with vm_state active and task_state deleting.
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-unplugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] No waiting events found dispatching network-vif-unplugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-unplugged-e08bd634-f27a-458e-a48b-21761864a105 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Acquiring lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] No waiting events found dispatching network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:32 user nova-compute[75206]: WARNING nova.compute.manager [req-76e510e5-9d97-4a60-8444-5fc75a1e07fa req-904a9553-77aa-4e78-9396-5d5c14131bf9 service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received unexpected event network-vif-plugged-e08bd634-f27a-458e-a48b-21761864a105 for instance with vm_state active and task_state deleting.
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:32 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Took 1.23 seconds to deallocate network for instance.
Nov 29 21:59:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a48eeea-0be3-48d3-8c8b-7e6f6bed377b req-b99eee6a-4c26-4813-9fd5-49cfdefe9f02 service nova] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Received event network-vif-deleted-ebe76bc7-4889-4a62-8564-3a3cd230d96e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:33 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Took 1.04 seconds to deallocate network for instance.
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:33 user nova-compute[75206]: INFO nova.compute.manager [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] [instance: 1d5f34b2-1301-4d46-9183-55c070ba28d5] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:33 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Deleted allocations for instance 25604878-4b0e-406f-bdf0-50b72f9ee117
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5ea9c5f5-8899-4800-bba4-0e21d6dd783a tempest-AttachVolumeNegativeTest-330553211 tempest-AttachVolumeNegativeTest-330553211-project-member] Lock "25604878-4b0e-406f-bdf0-50b72f9ee117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.449s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:33 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Deleted allocations for instance 1d5f34b2-1301-4d46-9183-55c070ba28d5
Nov 29 21:59:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0dab8087-a5df-4b19-a3ff-3e7f765e241d tempest-ServerActionsTestOtherB-957997184 tempest-ServerActionsTestOtherB-957997184-project-member] Lock "1d5f34b2-1301-4d46-9183-55c070ba28d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.849s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-615c15e0-160a-4a78-936e-3d6f46491048 req-76c89267-6a2a-4e0e-9179-de4e7bf3a15c service nova] [instance: 25604878-4b0e-406f-bdf0-50b72f9ee117] Received event network-vif-deleted-e08bd634-f27a-458e-a48b-21761864a105 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:59:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:59:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:46 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:59:46 user nova-compute[75206]: INFO nova.compute.claims [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Claim successful on node user
Nov 29 21:59:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:59:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:59:47 user nova-compute[75206]: INFO nova.compute.claims [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Claim successful on node user
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:59:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Creating image(s)
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "/opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "/opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "db6d80d286c3af0cfb398368f1145e4ca565121c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "db6d80d286c3af0cfb398368f1145e4ca565121c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.policy [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e456426697854165bbdd8d8f4a39cd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84edc3e740a04e4eb7cdec55bbc1f4c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.virt.images [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] 01f91b95-500c-4a2a-9940-eef1b06910b4 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.part /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.181s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.part /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.converted" returned: 0 in 0.399s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Successfully created port: fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.policy [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7d06116d600497090ba07fcb86ee782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fefc9dd69d944df892990a9db00c4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "db6d80d286c3af0cfb398368f1145e4ca565121c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.433s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:59:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Creating image(s)
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "db6d80d286c3af0cfb398368f1145e4ca565121c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "db6d80d286c3af0cfb398368f1145e4ca565121c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c,backing_fmt=raw /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c,backing_fmt=raw /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk 1073741824" returned: 0 in 0.080s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "db6d80d286c3af0cfb398368f1145e4ca565121c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk 1073741824" returned: 0 in 0.084s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.208s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Cannot resize image /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Ensure instance console log exists: /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Cannot resize image /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Ensure instance console log exists: /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Successfully created port: ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Successfully updated port: fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing instance network info cache due to event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance network_info: |[{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Start _get_guest_xml network_info=[{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:59:44Z,direct_url=<?>,disk_format='qcow2',id=01f91b95-500c-4a2a-9940-eef1b06910b4,min_disk=0,min_ram=0,name='tempest-scenario-img--344487005',owner='84edc3e740a04e4eb7cdec55bbc1f4c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:59:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '01f91b95-500c-4a2a-9940-eef1b06910b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:59:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:59:44Z,direct_url=<?>,disk_format='qcow2',id=01f91b95-500c-4a2a-9940-eef1b06910b4,min_disk=0,min_ram=0,name='tempest-scenario-img--344487005',owner='84edc3e740a04e4eb7cdec55bbc1f4c9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:59:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-999232757',display_name='tempest-TestMinimumBasicScenario-server-999232757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-999232757',id=34,image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuM24W/72UOg7BGLjw5WeFX6apW7aanvQ6vgDCTWQjzoaZnsIToTfrIY6S4TeucEPaBAysvgA2OnAIv8/lIHW1J9GHlbqzAXrSGX72soCxBrfr8sohBFRoqtz07aWI5oA==',key_name='tempest-TestMinimumBasicScenario-2140076803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-xnebfw4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:47Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=0c62b909-1f4f-4fec-a4c1-c330379083de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:59:50 user nova-compute[75206]:   <uuid>0c62b909-1f4f-4fec-a4c1-c330379083de</uuid>
Nov 29 21:59:50 user nova-compute[75206]:   <name>instance-00000022</name>
Nov 29 21:59:50 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:59:50 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:59:50 user nova-compute[75206]:   <metadata>
Nov 29 21:59:50 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:59:50 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:name>tempest-TestMinimumBasicScenario-server-999232757</nova:name>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:59:50</nova:creationTime>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:59:50 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:59:50 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:owner>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:user uuid="e456426697854165bbdd8d8f4a39cd77">tempest-TestMinimumBasicScenario-2060893910-project-member</nova:user>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:project uuid="84edc3e740a04e4eb7cdec55bbc1f4c9">tempest-TestMinimumBasicScenario-2060893910</nova:project>
Nov 29 21:59:50 user nova-compute[75206]:       </nova:owner>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:root type="image" uuid="01f91b95-500c-4a2a-9940-eef1b06910b4"/>
Nov 29 21:59:50 user nova-compute[75206]:       <nova:ports>
Nov 29 21:59:50 user nova-compute[75206]:         <nova:port uuid="fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b">
Nov 29 21:59:50 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 21:59:50 user nova-compute[75206]:         </nova:port>
Nov 29 21:59:50 user nova-compute[75206]:       </nova:ports>
Nov 29 21:59:50 user nova-compute[75206]:     </nova:instance>
Nov 29 21:59:50 user nova-compute[75206]:   </metadata>
Nov 29 21:59:50 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:59:50 user nova-compute[75206]:     <system>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="serial">0c62b909-1f4f-4fec-a4c1-c330379083de</entry>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="uuid">0c62b909-1f4f-4fec-a4c1-c330379083de</entry>
Nov 29 21:59:50 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:59:50 user nova-compute[75206]:     </system>
Nov 29 21:59:50 user nova-compute[75206]:   </sysinfo>
Nov 29 21:59:50 user nova-compute[75206]:   <os>
Nov 29 21:59:50 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:59:50 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:59:50 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:59:50 user nova-compute[75206]:   </os>
Nov 29 21:59:50 user nova-compute[75206]:   <features>
Nov 29 21:59:50 user nova-compute[75206]:     <acpi/>
Nov 29 21:59:50 user nova-compute[75206]:     <apic/>
Nov 29 21:59:50 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:59:50 user nova-compute[75206]:   </features>
Nov 29 21:59:50 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:59:50 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:59:50 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:59:50 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:59:50 user nova-compute[75206]:   </clock>
Nov 29 21:59:50 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:59:50 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:59:50 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:59:50 user nova-compute[75206]:   </cpu>
Nov 29 21:59:50 user nova-compute[75206]:   <devices>
Nov 29 21:59:50 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:59:50 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:59:50 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk"/>
Nov 29 21:59:50 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:59:50 user nova-compute[75206]:     </disk>
Nov 29 21:59:50 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:59:50 user nova-compute[75206]:       <mac address="fa:16:3e:49:84:86"/>
Nov 29 21:59:50 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:50 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:59:50 user nova-compute[75206]:       <target dev="tapfbaf3d5d-f4"/>
Nov 29 21:59:50 user nova-compute[75206]:     </interface>
Nov 29 21:59:50 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:59:50 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/console.log" append="off"/>
Nov 29 21:59:50 user nova-compute[75206]:     </serial>
Nov 29 21:59:50 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:59:50 user nova-compute[75206]:     <video>
Nov 29 21:59:50 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:50 user nova-compute[75206]:     </video>
Nov 29 21:59:50 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:59:50 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:59:50 user nova-compute[75206]:     </rng>
Nov 29 21:59:50 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:59:50 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:59:50 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:59:50 user nova-compute[75206]:     </memballoon>
Nov 29 21:59:50 user nova-compute[75206]:   </devices>
Nov 29 21:59:50 user nova-compute[75206]: </domain>
Nov 29 21:59:50 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-999232757',display_name='tempest-TestMinimumBasicScenario-server-999232757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-999232757',id=34,image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuM24W/72UOg7BGLjw5WeFX6apW7aanvQ6vgDCTWQjzoaZnsIToTfrIY6S4TeucEPaBAysvgA2OnAIv8/lIHW1J9GHlbqzAXrSGX72soCxBrfr8sohBFRoqtz07aWI5oA==',key_name='tempest-TestMinimumBasicScenario-2140076803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-xnebfw4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:47Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=0c62b909-1f4f-4fec-a4c1-c330379083de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG os_vif [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ff47791-34d8-5e15-b032-c44da296d81a', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbaf3d5d-f4, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbaf3d5d-f4, col_values=(('qos', UUID('555cbb1a-d1be-433b-8aeb-14e068e382df')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbaf3d5d-f4, col_values=(('external_ids', {'iface-id': 'fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:84:86', 'vm-uuid': '0c62b909-1f4f-4fec-a4c1-c330379083de'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:50 user nova-compute[75206]: INFO os_vif [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4')
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No VIF found with MAC fa:16:3e:49:84:86, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Successfully updated port: ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updated VIF entry in instance network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.neutron [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a4ed905-ace4-4ccf-b1eb-773d82117231 req-289da10c-c091-48a8-94f8-d907b6be53f2 service nova] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance network_info: |[{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start _get_guest_xml network_info=[{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:59:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiicWIESZg6ZA1V5akTgOlfmWCyvk8No5G04QgdDN91sEDfr2/XDfjjbD2/v1PgPvA7VINa1M7XE0t8Tg9UgAMo5TVW66u+QB+CbBVVAelegYRD87cxl/kio3EwdalrkA==',key_name='tempest-keypair-1481084862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.objects.instance [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:59:51 user nova-compute[75206]:   <uuid>5cc2418b-ae38-4884-a3e1-d0311f577d75</uuid>
Nov 29 21:59:51 user nova-compute[75206]:   <name>instance-00000023</name>
Nov 29 21:59:51 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 21:59:51 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 21:59:51 user nova-compute[75206]:   <metadata>
Nov 29 21:59:51 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:59:51 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1574489291</nova:name>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:creationTime>2023-11-29 21:59:51</nova:creationTime>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 21:59:51 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:59:51 user nova-compute[75206]:       </nova:flavor>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:owner>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:user uuid="e7d06116d600497090ba07fcb86ee782">tempest-AttachVolumeShelveTestJSON-700434495-project-member</nova:user>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:project uuid="0fefc9dd69d944df892990a9db00c4e8">tempest-AttachVolumeShelveTestJSON-700434495</nova:project>
Nov 29 21:59:51 user nova-compute[75206]:       </nova:owner>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 21:59:51 user nova-compute[75206]:       <nova:ports>
Nov 29 21:59:51 user nova-compute[75206]:         <nova:port uuid="ec0d31a2-a6f7-4d7f-b998-96b5730c9150">
Nov 29 21:59:51 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 21:59:51 user nova-compute[75206]:         </nova:port>
Nov 29 21:59:51 user nova-compute[75206]:       </nova:ports>
Nov 29 21:59:51 user nova-compute[75206]:     </nova:instance>
Nov 29 21:59:51 user nova-compute[75206]:   </metadata>
Nov 29 21:59:51 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 21:59:51 user nova-compute[75206]:     <system>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="serial">5cc2418b-ae38-4884-a3e1-d0311f577d75</entry>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="uuid">5cc2418b-ae38-4884-a3e1-d0311f577d75</entry>
Nov 29 21:59:51 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:59:51 user nova-compute[75206]:     </system>
Nov 29 21:59:51 user nova-compute[75206]:   </sysinfo>
Nov 29 21:59:51 user nova-compute[75206]:   <os>
Nov 29 21:59:51 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:59:51 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 21:59:51 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 21:59:51 user nova-compute[75206]:   </os>
Nov 29 21:59:51 user nova-compute[75206]:   <features>
Nov 29 21:59:51 user nova-compute[75206]:     <acpi/>
Nov 29 21:59:51 user nova-compute[75206]:     <apic/>
Nov 29 21:59:51 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 21:59:51 user nova-compute[75206]:   </features>
Nov 29 21:59:51 user nova-compute[75206]:   <clock offset="utc">
Nov 29 21:59:51 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:59:51 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:59:51 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 21:59:51 user nova-compute[75206]:   </clock>
Nov 29 21:59:51 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 21:59:51 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 21:59:51 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:59:51 user nova-compute[75206]:   </cpu>
Nov 29 21:59:51 user nova-compute[75206]:   <devices>
Nov 29 21:59:51 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 21:59:51 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:59:51 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk"/>
Nov 29 21:59:51 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 21:59:51 user nova-compute[75206]:     </disk>
Nov 29 21:59:51 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 21:59:51 user nova-compute[75206]:       <mac address="fa:16:3e:a7:ec:c1"/>
Nov 29 21:59:51 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:51 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 21:59:51 user nova-compute[75206]:       <target dev="tapec0d31a2-a6"/>
Nov 29 21:59:51 user nova-compute[75206]:     </interface>
Nov 29 21:59:51 user nova-compute[75206]:     <serial type="pty">
Nov 29 21:59:51 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/console.log" append="off"/>
Nov 29 21:59:51 user nova-compute[75206]:     </serial>
Nov 29 21:59:51 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:59:51 user nova-compute[75206]:     <video>
Nov 29 21:59:51 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 21:59:51 user nova-compute[75206]:     </video>
Nov 29 21:59:51 user nova-compute[75206]:     <rng model="virtio">
Nov 29 21:59:51 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:59:51 user nova-compute[75206]:     </rng>
Nov 29 21:59:51 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:59:51 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 21:59:51 user nova-compute[75206]:       <stats period="10"/>
Nov 29 21:59:51 user nova-compute[75206]:     </memballoon>
Nov 29 21:59:51 user nova-compute[75206]:   </devices>
Nov 29 21:59:51 user nova-compute[75206]: </domain>
Nov 29 21:59:51 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiicWIESZg6ZA1V5akTgOlfmWCyvk8No5G04QgdDN91sEDfr2/XDfjjbD2/v1PgPvA7VINa1M7XE0t8Tg9UgAMo5TVW66u+QB+CbBVVAelegYRD87cxl/kio3EwdalrkA==',key_name='tempest-keypair-1481084862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG os_vif [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2622738-4505-5283-bc84-480ee2f9b569', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec0d31a2-a6, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec0d31a2-a6, col_values=(('qos', UUID('62e8831f-1bce-4d15-bbec-f288c72c1130')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec0d31a2-a6, col_values=(('external_ids', {'iface-id': 'ec0d31a2-a6f7-4d7f-b998-96b5730c9150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ec:c1', 'vm-uuid': '5cc2418b-ae38-4884-a3e1-d0311f577d75'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:51 user nova-compute[75206]: INFO os_vif [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6')
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:59:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No VIF found with MAC fa:16:3e:a7:ec:c1, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing instance network info cache due to event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updated VIF entry in instance network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f7738974-3538-4046-8fe5-d8bcc292bdd3 req-47ce9821-1f0b-4e16-9da1-e5bf3d03a16a service nova] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:52 user nova-compute[75206]: WARNING nova.compute.manager [req-11254e68-983e-419b-947a-5ef631d1a701 req-cf5d023c-d8c0-41fc-9fc8-5b868cf7b7df service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state building and task_state spawning.
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:54 user nova-compute[75206]: WARNING nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state building and task_state spawning.
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:54 user nova-compute[75206]: WARNING nova.compute.manager [req-77ca2299-16eb-4abf-9aa2-07f91f9d41c3 req-6ea1e9ac-bbd3-4e7e-8e4f-1d9ea74aed3c service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state building and task_state spawning.
Nov 29 21:59:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:59:54 user nova-compute[75206]: WARNING nova.compute.manager [req-4a7b2971-0cc0-488c-aa49-98e5f4e25298 req-381ecff7-9bd1-4eea-b079-b8b494b2bb72 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state building and task_state spawning.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance spawned successfully.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance spawned successfully.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Took 8.33 seconds to spawn the instance on the hypervisor.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.compute.manager [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Took 8.55 seconds to build instance.
Nov 29 21:59:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-31792cb0-e2dc-4b83-a1ac-99714c4f393e tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.648s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:55 user nova-compute[75206]: INFO nova.compute.manager [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Took 9.09 seconds to build instance.
Nov 29 21:59:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-95b61e2f-0c98-4685-937e-e5a7486b8998 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.185s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:59:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:59:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:00:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:00:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7861MB free_disk=24.93768310546875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 0c62b909-1f4f-4fec-a4c1-c330379083de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:00:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:00:32 user nova-compute[75206]: INFO nova.compute.claims [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Claim successful on node user
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:00:32 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG nova.policy [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '656a5b2470e14813b3060d41b1d61095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa0640f6b84a71b856782e45ca4adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:00:32 user nova-compute[75206]: INFO nova.virt.block_device [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Booting with volume 554084b0-93f5-4a09-b74b-ecdb4e78779c at /dev/vda
Nov 29 22:00:32 user nova-compute[75206]: DEBUG os_brick.utils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2778e-68cb-435f-8198-af34632dd9d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51253d1f-699a-4e88-97f0-69c3d2b10c8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4381c7ff-cf43-4ea8-9191-27df247a5c41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f0cfd-8465-4863-86cf-7c6b7dd95d59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:00:32 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:00:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b60b9b-2c4d-435f-9ad5-dcc322e8c9ce]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG os_brick.utils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating existing volume attachment record: 2d6856d1-925f-4a7d-9f2c-56454cfbc41c {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:00:33 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Successfully created port: 7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Successfully updated port: 7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-changed-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Refreshing instance network info cache due to event network-changed-7453adc6-895e-4bd0-8cdf-8e554a65ada7. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Skipping network cache update for instance because it is Building. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance network_info: |[{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Refreshing network info cache for port 7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:00:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updated VIF entry in instance network info cache for port 7453adc6-895e-4bd0-8cdf-8e554a65ada7. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b8fe8bb7-2b67-491e-a5fe-7dc7293f1706 req-c6973db1-5ffb-468b-af18-f360e698d546 service nova] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:00:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:00:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:00:39 user nova-compute[75206]: INFO nova.compute.manager [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] instance snapshotting
Nov 29 22:00:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Beginning live snapshot process
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json -f qcow2 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9.delta 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9.delta 1073741824" returned: 0 in 0.063s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 22:00:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 22:00:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] COPY block job progress, current cursor: 18153472 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 22:00:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:00:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75206) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 22:00:41 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 22:00:41 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:00:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9.delta /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:00:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Creating image(s)
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Ensure instance console log exists: /opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start _get_guest_xml network_info=[{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '2d6856d1-925f-4a7d-9f2c-56454cfbc41c', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47df4638-2c13-4c33-8b8d-f7a5d5d3338f', 'attached_at': '', 'detached_at': '', 'volume_id': '554084b0-93f5-4a09-b74b-ecdb4e78779c', 'serial': '554084b0-93f5-4a09-b74b-ecdb4e78779c'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:00:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:00:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:00:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:00:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:00:42 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9806c3d5-7acc-4246-abc0-4743c4f188f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:00:42 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa63125f-f242-43c6-aa01-4050005908d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c] added
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef1b3b0-1515-49f1-adac-8f9390b8ee92]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e69e8-29b3-4686-af48-04c7bcf4a8cf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9.delta /opt/stack/data/nova/instances/snapshots/tmp1obj6q4k/ffc465f7f9174fe88eca837a2c6d35a9" returned: 0 in 0.696s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Snapshot extracted, beginning image upload
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLPHXVED {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLPHXVED" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a637f82-87a9-4bd3-bf3d-edf7da04710b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLPHXVED'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a8c84-22ad-4418-bcf6-75d2f1ca88f0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319abfc-5eb3-4621-9e59-087270a2aaa4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82ee7c-bfad-432e-b3c6-0267a09b3d11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]
Nov 29 22:00:42 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de88b5-be13-4cf3-ae5e-c5370b492d70]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52762d-b7c1-4cf1-9d38-7f7369dadfb5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:00:42 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:00:42 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:00:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea73917-45b9-46ed-8f32-3a5c494c4759]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:00:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23034643638383061', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034643638383061', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'pci_devices' on Instance uuid 47df4638-2c13-4c33-8b8d-f7a5d5d3338f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:00:43 user nova-compute[75206]:   <uuid>47df4638-2c13-4c33-8b8d-f7a5d5d3338f</uuid>
Nov 29 22:00:43 user nova-compute[75206]:   <name>instance-00000024</name>
Nov 29 22:00:43 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:00:43 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:00:43 user nova-compute[75206]:   <metadata>
Nov 29 22:00:43 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:00:43 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:00:43 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherA-server-358814846</nova:name>
Nov 29 22:00:43 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:00:42</nova:creationTime>
Nov 29 22:00:43 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:00:43 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:00:43 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:00:43 user nova-compute[75206]:       <nova:owner>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:user uuid="656a5b2470e14813b3060d41b1d61095">tempest-ServerActionsTestOtherA-2043072317-project-member</nova:user>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:project uuid="feaa0640f6b84a71b856782e45ca4adf">tempest-ServerActionsTestOtherA-2043072317</nova:project>
Nov 29 22:00:43 user nova-compute[75206]:       </nova:owner>
Nov 29 22:00:43 user nova-compute[75206]:       <nova:ports>
Nov 29 22:00:43 user nova-compute[75206]:         <nova:port uuid="7453adc6-895e-4bd0-8cdf-8e554a65ada7">
Nov 29 22:00:43 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 22:00:43 user nova-compute[75206]:         </nova:port>
Nov 29 22:00:43 user nova-compute[75206]:       </nova:ports>
Nov 29 22:00:43 user nova-compute[75206]:     </nova:instance>
Nov 29 22:00:43 user nova-compute[75206]:   </metadata>
Nov 29 22:00:43 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:00:43 user nova-compute[75206]:     <system>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="serial">47df4638-2c13-4c33-8b8d-f7a5d5d3338f</entry>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="uuid">47df4638-2c13-4c33-8b8d-f7a5d5d3338f</entry>
Nov 29 22:00:43 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:00:43 user nova-compute[75206]:     </system>
Nov 29 22:00:43 user nova-compute[75206]:   </sysinfo>
Nov 29 22:00:43 user nova-compute[75206]:   <os>
Nov 29 22:00:43 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:00:43 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:00:43 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:00:43 user nova-compute[75206]:   </os>
Nov 29 22:00:43 user nova-compute[75206]:   <features>
Nov 29 22:00:43 user nova-compute[75206]:     <acpi/>
Nov 29 22:00:43 user nova-compute[75206]:     <apic/>
Nov 29 22:00:43 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:00:43 user nova-compute[75206]:   </features>
Nov 29 22:00:43 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:00:43 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:00:43 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:00:43 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:00:43 user nova-compute[75206]:   </clock>
Nov 29 22:00:43 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:00:43 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:00:43 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:00:43 user nova-compute[75206]:   </cpu>
Nov 29 22:00:43 user nova-compute[75206]:   <devices>
Nov 29 22:00:43 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:00:43 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:00:43 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 22:00:43 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:00:43 user nova-compute[75206]:       <serial>554084b0-93f5-4a09-b74b-ecdb4e78779c</serial>
Nov 29 22:00:43 user nova-compute[75206]:     </disk>
Nov 29 22:00:43 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:00:43 user nova-compute[75206]:       <mac address="fa:16:3e:b2:ed:ac"/>
Nov 29 22:00:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:00:43 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:00:43 user nova-compute[75206]:       <target dev="tap7453adc6-89"/>
Nov 29 22:00:43 user nova-compute[75206]:     </interface>
Nov 29 22:00:43 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:00:43 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f/console.log" append="off"/>
Nov 29 22:00:43 user nova-compute[75206]:     </serial>
Nov 29 22:00:43 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:00:43 user nova-compute[75206]:     <video>
Nov 29 22:00:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:00:43 user nova-compute[75206]:     </video>
Nov 29 22:00:43 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:00:43 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:00:43 user nova-compute[75206]:     </rng>
Nov 29 22:00:43 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:00:43 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:00:43 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:00:43 user nova-compute[75206]:     </memballoon>
Nov 29 22:00:43 user nova-compute[75206]:   </devices>
Nov 29 22:00:43 user nova-compute[75206]: </domain>
Nov 29 22:00:43 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG os_vif [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '363b1f19-bdcb-5aec-87e8-17242e9ce4c3', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7453adc6-89, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7453adc6-89, col_values=(('qos', UUID('985cdadc-3752-41ab-ae78-7e98e6b6bbad')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7453adc6-89, col_values=(('external_ids', {'iface-id': '7453adc6-895e-4bd0-8cdf-8e554a65ada7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ed:ac', 'vm-uuid': '47df4638-2c13-4c33-8b8d-f7a5d5d3338f'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:43 user nova-compute[75206]: INFO os_vif [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89')
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:00:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:b2:ed:ac, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Snapshot image upload complete
Nov 29 22:00:45 user nova-compute[75206]: INFO nova.compute.manager [None req-0d7db2cb-1ff9-43cd-88f0-e09aae1c6e46 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Took 6.47 seconds to snapshot the instance on the hypervisor.
Nov 29 22:00:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:00:45 user nova-compute[75206]: WARNING nova.compute.manager [req-2aabdb18-a03a-4db0-8d57-7ccf69abaa05 req-e740bb11-bb89-4174-9b39-46051653e439 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state building and task_state spawning.
Nov 29 22:00:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:00:47 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance spawned successfully.
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:00:47 user nova-compute[75206]: WARNING nova.compute.manager [req-bfaa7a99-af7b-47c9-8c33-228677b9bf9d req-c43a19f2-01b4-4cee-8ca3-3cc421bcb17c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state building and task_state spawning.
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:00:47 user nova-compute[75206]: INFO nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 29 22:00:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:00:47 user nova-compute[75206]: INFO nova.compute.manager [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Took 15.81 seconds to build instance.
Nov 29 22:00:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c551ec72-fd38-4ad3-9529-f2fb2c80f586 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.915s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:00:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:00:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:00:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:01:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing instance network info cache due to event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.objects.instance [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'flavor' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:03 user nova-compute[75206]: INFO nova.compute.manager [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Attaching volume a1fb7adb-d318-43b4-a301-eb402edd49ac to /dev/vdb
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29d007-c77c-4571-841e-af00ffe616a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82520a0-c213-4e3c-8e6d-a5fe579841ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495e4b9-0c8c-4d54-a1e3-5729fc129c79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ba10f-8fe8-497b-b916-2633897f94e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updated VIF entry in instance network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4993d7d2-b7f6-4b1d-a302-e5866a814f0f req-473e137e-3514-49db-a3c2-d8e329089548 service nova] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:01:03 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:01:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92b1ed4-a8bb-4c46-891a-7c2a8a088118]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating existing volume attachment record: 6d49d08f-6537-4cbf-a501-4eea32287ed9 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:01:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvPRVAzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:01:21 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:01:21 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:01:21 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5111bff5-560b-4ebf-a460-38c0aedbeb40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:01:21 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56e71a-7c8c-4e2d-8629-2304436d414a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac] added
Nov 29 22:01:21 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01894ecb-2a13-43e0-8f41-ad129c6ddd9f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:21 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f722e-d35b-4e1b-a23f-665c7834d11f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lvPRVAzJ {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lvPRVAzJ" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[317aa495-2fb7-4655-82bd-651caecdc97d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lvPRVAzJ'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda92d6-bdbe-4ba1-b458-37a5068e4eaa]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32052961-341f-4ef9-8b8b-a37df1fd5066]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c3059-acab-4d71-a2d0-8501d7ca4d46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260]
Nov 29 22:01:22 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260] successful.
Nov 29 22:01:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c63c3-44f9-4de9-8f3e-b2ad5ab9b296]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8c576-16a8-4170-930e-79c93e063eed]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:22 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d9e41-a95e-4cd2-8725-0d3cbd23f845]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:01:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvPRVAzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23331333239343239', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331333239343239', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.objects.instance [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'flavor' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:01:23 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:01:23 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 22:01:23 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:01:23 user nova-compute[75206]:   <serial>a1fb7adb-d318-43b4-a301-eb402edd49ac</serial>
Nov 29 22:01:23 user nova-compute[75206]: </disk>
Nov 29 22:01:23 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:cd:99:8d, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6dabfd17-d524-4315-8c9f-a17c4428d607 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.484s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:24 user nova-compute[75206]: INFO nova.compute.manager [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Rescuing
Nov 29 22:01:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:25 user nova-compute[75206]: WARNING nova.compute.manager [req-b0d5d455-1522-43a3-b131-eb82613bd00f req-bd33b337-71f9-4a70-b723-21be847e1127 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state rescuing.
Nov 29 22:01:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:01:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance destroyed successfully.
Nov 29 22:01:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Attempting rescue
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 22:01:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Creating image(s)
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'trusted_certs' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue" returned: 0 in 0.051s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'migration_context' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<21ba84fd-5988-4a9c-8b2b-b710981d5be5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start _get_guest_xml network_info=[{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:cd:99:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<21ba84fd-5988-4a9c-8b2b-b710981d5be5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'numa_topology' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<21ba84fd-5988-4a9c-8b2b-b710981d5be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:26 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:01:26 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'vcpu_model' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<21ba84fd-5988-4a9c-8b2b-b710981d5be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-555833462',display_name='tempest-ServerRescueNegativeTestJSON-server-555833462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-555833462',id=33,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoboCZMxVTfgRk1v85pAzAHlE0D3c1Dnq8H8Pq9WEa4pe9EM9RAkjx74BBBscZynnADJM80ke9KGFTSgcS9/aiUHbEU/M16jv/uWrOJ9aAuGvRkuhzKx0IL3g53dhU2ZA==',key_name='tempest-keypair-39788666',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-hsyq27bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=21ba84fd-5988-4a9c-8b2b-b710981d5be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:cd:99:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "vif_mac": "fa:16:3e:cd:99:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'pci_devices' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.objects.base [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Object Instance<21ba84fd-5988-4a9c-8b2b-b710981d5be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:01:26 user nova-compute[75206]:   <uuid>21ba84fd-5988-4a9c-8b2b-b710981d5be5</uuid>
Nov 29 22:01:26 user nova-compute[75206]:   <name>instance-00000021</name>
Nov 29 22:01:26 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:01:26 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:01:26 user nova-compute[75206]:   <metadata>
Nov 29 22:01:26 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:01:26 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-555833462</nova:name>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:01:26</nova:creationTime>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:01:26 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:01:26 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:owner>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:user uuid="93bf49b7d7334849ae0ed9632fa3c508">tempest-ServerRescueNegativeTestJSON-527018362-project-member</nova:user>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:project uuid="e4e3eac3db4a4ca09a436c696b50ada2">tempest-ServerRescueNegativeTestJSON-527018362</nova:project>
Nov 29 22:01:26 user nova-compute[75206]:       </nova:owner>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:01:26 user nova-compute[75206]:       <nova:ports>
Nov 29 22:01:26 user nova-compute[75206]:         <nova:port uuid="5b614235-5a18-4441-bac0-0c3573f0c014">
Nov 29 22:01:26 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 22:01:26 user nova-compute[75206]:         </nova:port>
Nov 29 22:01:26 user nova-compute[75206]:       </nova:ports>
Nov 29 22:01:26 user nova-compute[75206]:     </nova:instance>
Nov 29 22:01:26 user nova-compute[75206]:   </metadata>
Nov 29 22:01:26 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:01:26 user nova-compute[75206]:     <system>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="serial">21ba84fd-5988-4a9c-8b2b-b710981d5be5</entry>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="uuid">21ba84fd-5988-4a9c-8b2b-b710981d5be5</entry>
Nov 29 22:01:26 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:01:26 user nova-compute[75206]:     </system>
Nov 29 22:01:26 user nova-compute[75206]:   </sysinfo>
Nov 29 22:01:26 user nova-compute[75206]:   <os>
Nov 29 22:01:26 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:01:26 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:01:26 user nova-compute[75206]:   </os>
Nov 29 22:01:26 user nova-compute[75206]:   <features>
Nov 29 22:01:26 user nova-compute[75206]:     <acpi/>
Nov 29 22:01:26 user nova-compute[75206]:     <apic/>
Nov 29 22:01:26 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:01:26 user nova-compute[75206]:   </features>
Nov 29 22:01:26 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:01:26 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:01:26 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:01:26 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:01:26 user nova-compute[75206]:   </clock>
Nov 29 22:01:26 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:01:26 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:01:26 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:01:26 user nova-compute[75206]:   </cpu>
Nov 29 22:01:26 user nova-compute[75206]:   <devices>
Nov 29 22:01:26 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:01:26 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:01:26 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue"/>
Nov 29 22:01:26 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:01:26 user nova-compute[75206]:     </disk>
Nov 29 22:01:26 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:01:26 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:01:26 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk"/>
Nov 29 22:01:26 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 22:01:26 user nova-compute[75206]:     </disk>
Nov 29 22:01:26 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:01:26 user nova-compute[75206]:       <mac address="fa:16:3e:cd:99:8d"/>
Nov 29 22:01:26 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:01:26 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:01:26 user nova-compute[75206]:       <target dev="tap5b614235-5a"/>
Nov 29 22:01:26 user nova-compute[75206]:     </interface>
Nov 29 22:01:26 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:01:26 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/console.log" append="off"/>
Nov 29 22:01:26 user nova-compute[75206]:     </serial>
Nov 29 22:01:26 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:01:26 user nova-compute[75206]:     <video>
Nov 29 22:01:26 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:01:26 user nova-compute[75206]:     </video>
Nov 29 22:01:26 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:01:26 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:01:26 user nova-compute[75206]:     </rng>
Nov 29 22:01:26 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:01:26 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:01:26 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:01:26 user nova-compute[75206]:     </memballoon>
Nov 29 22:01:26 user nova-compute[75206]:   </devices>
Nov 29 22:01:26 user nova-compute[75206]: </domain>
Nov 29 22:01:26 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:01:26 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance destroyed successfully.
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] No VIF found with MAC fa:16:3e:cd:99:8d, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:01:26 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:27 user nova-compute[75206]: WARNING nova.compute.manager [req-5dce7b17-22fc-47ff-a658-afdfcf9d5e60 req-3168deda-ac0f-4506-90ae-a4c881b5ceb9 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state rescuing.
Nov 29 22:01:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:29 user nova-compute[75206]: WARNING nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state rescuing.
Nov 29 22:01:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:29 user nova-compute[75206]: WARNING nova.compute.manager [req-b224e5f7-b8cf-4a91-a2e6-e6cf98802ed2 req-1ae70325-324d-401b-b751-363e87a8dbe0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state rescuing.
Nov 29 22:01:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8d584008-8d06-4887-80e6-d79b3600456c tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:01:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7921MB free_disk=24.87338638305664GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 0c62b909-1f4f-4fec-a4c1-c330379083de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:01:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:01:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:01:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:01:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:01:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:01:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG nova.compute.manager [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing instance network info cache due to event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:39 user nova-compute[75206]: DEBUG nova.network.neutron [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:01:40 user nova-compute[75206]: DEBUG nova.network.neutron [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updated VIF entry in instance network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:01:40 user nova-compute[75206]: DEBUG nova.network.neutron [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8480ef9c-505e-4473-b85e-922af375fea9 req-197e48af-fcca-453d-bb4b-b7bc60eb9520 service nova] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:41 user nova-compute[75206]: INFO nova.compute.manager [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Attaching volume 1f1e6f71-c71f-48d1-84c1-ba74e8555fde to /dev/vdb
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.utils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d43f3-fb02-4e09-9bba-3623570b169f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e5e091-fd5b-45cf-8d3d-d0dcaa549ca2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797edec-ad7a-42ad-be9e-39bfd7f990e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f99da-2b0f-47d0-88d8-51359236a2ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:01:42 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[136562ad-ccb2-4304-8b51-e93b4b6a0db2]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG os_brick.utils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating existing volume attachment record: a6e77347-ab18-44fc-9667-ccfd8f96006c {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:42 user nova-compute[75206]: INFO nova.compute.manager [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Shelving
Nov 29 22:01:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:43 user nova-compute[75206]: WARNING nova.compute.manager [req-8ac54485-db76-4fe5-bf6d-0c5324c24783 req-f820a5dc-6984-4f06-9ef1-c99bc5c9c0d6 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state active and task_state shelving.
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance destroyed successfully.
Nov 29 22:01:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Beginning cold snapshot process
Nov 29 22:01:43 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk /opt/stack/data/nova/instances/snapshots/tmp9a_cv3xr/d027be3772074bc5bcabe88d8ff89671 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk /opt/stack/data/nova/instances/snapshots/tmp9a_cv3xr/d027be3772074bc5bcabe88d8ff89671" returned: 0 in 1.027s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:44 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Snapshot extracted, beginning image upload
Nov 29 22:01:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:01:45 user nova-compute[75206]: WARNING nova.compute.manager [req-dc1ffddb-7fbc-4d5b-b01a-a92c87aeea98 req-6c185f98-5ed1-496a-89a6-760eceb1133f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 22:01:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Snapshot image upload complete
Nov 29 22:01:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:01:48 user nova-compute[75206]: INFO nova.compute.manager [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Shelve offloading
Nov 29 22:01:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance destroyed successfully.
Nov 29 22:01:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:01:49 user nova-compute[75206]: INFO nova.compute.claims [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Claim successful on node user
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:01:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:01:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:01:49 user nova-compute[75206]: INFO nova.virt.block_device [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Booting with volume-backed-image e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d at /dev/vda
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.policy [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79424ddb3af406d9ed8a1626a8f03ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ffcb36d26c41cd99ccb16570f285dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:01:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance destroyed successfully.
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'resources' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiicWIESZg6ZA1V5akTgOlfmWCyvk8No5G04QgdDN91sEDfr2/XDfjjbD2/v1PgPvA7VINa1M7XE0t8Tg9UgAMo5TVW66u+QB+CbBVVAelegYRD87cxl/kio3EwdalrkA==',key_name='tempest-keypair-1481084862',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:01:48.148198',shelved_host='user',shelved_image_id='18a33149-5e7d-4248-8771-b274f9438005'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG os_vif [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec0d31a2-a6, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing instance network info cache due to event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.network.neutron [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62e8831f-1bce-4d15-bbec-f288c72c1130) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:01:50 user nova-compute[75206]: INFO os_vif [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6')
Nov 29 22:01:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Deleting instance files /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75_del
Nov 29 22:01:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Deletion of /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75_del complete
Nov 29 22:01:50 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Deleted allocations for instance 5cc2418b-ae38-4884-a3e1-d0311f577d75
Nov 29 22:01:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'numa_topology' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:50 user nova-compute[75206]: DEBUG nova.objects.base [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<5cc2418b-ae38-4884-a3e1-d0311f577d75> lazy-loaded attributes: resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:01:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:01:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:01:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Successfully created port: 4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:01:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9d02f07a-fa77-447b-853d-4f0fe75d16de tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.668s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updated VIF entry in instance network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:01:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-70152cdc-a838-47be-be39-eca551973874 req-ced5d382-54e9-4ad3-9229-ca49bc00a513 service nova] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Successfully updated port: 4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-changed-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Refreshing instance network info cache due to event network-changed-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] Acquiring lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:01:53 user nova-compute[75206]: WARNING nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 50c12935-165b-4de9-99c0-4e8ce348e6df {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid f5314b05-629e-4844-9496-f8e23c5c2e01 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 47df4638-2c13-4c33-8b8d-f7a5d5d3338f {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating instance_info_cache with network_info: [{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZowrYRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:01:53 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:01:53 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:01:53 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance network_info: |[{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] Acquired lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Refreshing network info cache for port 4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[659992ce-a4c8-405b-b0cb-d9e5fc1afeb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:01:53 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deda546-8d6b-4b2f-8fba-a1611a0f86cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde] added
Nov 29 22:01:53 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29053f52-5b84-4b72-a04d-7427f3835e2b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deca739-b35d-4ec9-9fe9-aab1c178f476]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZowrYRf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZowrYRf" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[22425778-7a9e-4cda-9955-fffd75461af7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sZowrYRf'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e7ffd-9dff-4cc2-b1f1-7d65a4bed687]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9acb8a-b63c-4e76-8767-e8aca0578827]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d0d9bb-6e8e-4ab7-91ee-73e8a8593727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260]
Nov 29 22:01:54 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260] successful.
Nov 29 22:01:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f97cfe6-3e60-41d4-9eb8-b7f3c4bd1107]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3999e35-81c6-4843-a26e-f6b1d89f445e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:01:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:01:54 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:01:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7714010b-11b1-4b4b-bd31-ba653116dbc4]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updated VIF entry in instance network info cache for port 4a8928f1-cbe4-4d06-9570-173b2ed0e8c1. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG nova.network.neutron [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating instance_info_cache with network_info: [{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-da9bcd66-77ef-4b6b-9839-9c4dad4a87f8 req-12335259-b181-464b-ba0c-8071e884ca32 service nova] Releasing lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZowrYRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23461313465346563', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461313465346563', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:01:55 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:01:55 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:01:55 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:01:55 user nova-compute[75206]:   <serial>1f1e6f71-c71f-48d1-84c1-ba74e8555fde</serial>
Nov 29 22:01:55 user nova-compute[75206]: </disk>
Nov 29 22:01:55 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] No VIF found with MAC fa:16:3e:49:84:86, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f8a293b-21ba-4df1-b215-d398732ee2e5 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.915s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.328s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:01:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:01:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing instance network info cache due to event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updated VIF entry in instance network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:01:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-34fa6f8e-bd1d-4c90-9301-f50c98cf1215 req-a1cfb218-0ef9-4d2e-9bb4-96d4be9e26c4 service nova] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG os_brick.utils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[982bd845-9100-4d85-b492-08307be9710d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[992377de-0401-4c0f-8bc1-d23f2090a8b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf458fa8-3ebf-4031-9412-39ec929ac61a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf464607-c859-4d47-9c8b-4d86fb4a625f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:01 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:02:01 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d18e900-ed3b-46ed-825e-67a7b92db61c]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG os_brick.utils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:01 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating existing volume attachment record: 5be472ed-798f-4ef2-8e34-6cbc11449e62 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing instance network info cache due to event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:02:02 user nova-compute[75206]: INFO nova.compute.claims [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Claim successful on node user
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updated VIF entry in instance network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:02 user nova-compute[75206]: INFO nova.compute.manager [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Rebooting instance
Nov 29 22:02:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-aa2181d6-7ad5-4c22-befe-a30823908ea9 req-bab3cd37-93d2-439f-9a1f-ee8c433072b5 service nova] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:02:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.network.neutron [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.policy [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16af9212f6a8404cb84376f4b631feb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2957ca1e73e846229fb7a95b5f44994d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:02:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Creating image(s)
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "/opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "/opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk 1073741824" returned: 0 in 0.061s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Successfully created port: 483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Cannot resize image /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Ensure instance console log exists: /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Successfully updated port: 483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquired lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-changed-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Refreshing instance network info cache due to event network-changed-483f2cab-108a-4dd9-b2b7-ab9a188e0899. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] Acquiring lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.neutron [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating instance_info_cache with network_info: [{"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Releasing lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Instance network_info: |[{"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] Acquired lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.neutron [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Refreshing network info cache for port 483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Start _get_guest_xml network_info=[{"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:02:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1444831382',display_name='tempest-TestServerVolumeAttachmentScenario-server-1444831382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1444831382',id=38,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZHYBJvdUAhW1+avxp4PP6A2k5NVxsiP6O3rHpsZzqZ6g9RB+GpolifkHZEs5rvECynJjhfTSqQ/NN+5gZmHvKSlh7DT/Sr5rIp3eEeGggUf1Qe0y6BvnEoYI8cuHbfew==',key_name='tempest-keypair-1183905999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2957ca1e73e846229fb7a95b5f44994d',ramdisk_id='',reservation_id='r-00a2wsr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1924217286',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1924217286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16af9212f6a8404cb84376f4b631feb1',uuid=e1e67b78-6589-4d67-b70f-96907954cb00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converting VIF {"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'pci_devices' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:02:05 user nova-compute[75206]:   <uuid>e1e67b78-6589-4d67-b70f-96907954cb00</uuid>
Nov 29 22:02:05 user nova-compute[75206]:   <name>instance-00000026</name>
Nov 29 22:02:05 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:02:05 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:02:05 user nova-compute[75206]:   <metadata>
Nov 29 22:02:05 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:02:05 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1444831382</nova:name>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:02:05</nova:creationTime>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:02:05 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:02:05 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:owner>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:user uuid="16af9212f6a8404cb84376f4b631feb1">tempest-TestServerVolumeAttachmentScenario-1924217286-project-member</nova:user>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:project uuid="2957ca1e73e846229fb7a95b5f44994d">tempest-TestServerVolumeAttachmentScenario-1924217286</nova:project>
Nov 29 22:02:05 user nova-compute[75206]:       </nova:owner>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:02:05 user nova-compute[75206]:       <nova:ports>
Nov 29 22:02:05 user nova-compute[75206]:         <nova:port uuid="483f2cab-108a-4dd9-b2b7-ab9a188e0899">
Nov 29 22:02:05 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 22:02:05 user nova-compute[75206]:         </nova:port>
Nov 29 22:02:05 user nova-compute[75206]:       </nova:ports>
Nov 29 22:02:05 user nova-compute[75206]:     </nova:instance>
Nov 29 22:02:05 user nova-compute[75206]:   </metadata>
Nov 29 22:02:05 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:02:05 user nova-compute[75206]:     <system>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="serial">e1e67b78-6589-4d67-b70f-96907954cb00</entry>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="uuid">e1e67b78-6589-4d67-b70f-96907954cb00</entry>
Nov 29 22:02:05 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:02:05 user nova-compute[75206]:     </system>
Nov 29 22:02:05 user nova-compute[75206]:   </sysinfo>
Nov 29 22:02:05 user nova-compute[75206]:   <os>
Nov 29 22:02:05 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:02:05 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:02:05 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:02:05 user nova-compute[75206]:   </os>
Nov 29 22:02:05 user nova-compute[75206]:   <features>
Nov 29 22:02:05 user nova-compute[75206]:     <acpi/>
Nov 29 22:02:05 user nova-compute[75206]:     <apic/>
Nov 29 22:02:05 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:02:05 user nova-compute[75206]:   </features>
Nov 29 22:02:05 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:02:05 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:02:05 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:02:05 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:02:05 user nova-compute[75206]:   </clock>
Nov 29 22:02:05 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:02:05 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:02:05 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:02:05 user nova-compute[75206]:   </cpu>
Nov 29 22:02:05 user nova-compute[75206]:   <devices>
Nov 29 22:02:05 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:02:05 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:02:05 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk"/>
Nov 29 22:02:05 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:02:05 user nova-compute[75206]:     </disk>
Nov 29 22:02:05 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:02:05 user nova-compute[75206]:       <mac address="fa:16:3e:e3:e5:44"/>
Nov 29 22:02:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:05 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:02:05 user nova-compute[75206]:       <target dev="tap483f2cab-10"/>
Nov 29 22:02:05 user nova-compute[75206]:     </interface>
Nov 29 22:02:05 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:02:05 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/console.log" append="off"/>
Nov 29 22:02:05 user nova-compute[75206]:     </serial>
Nov 29 22:02:05 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:02:05 user nova-compute[75206]:     <video>
Nov 29 22:02:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:05 user nova-compute[75206]:     </video>
Nov 29 22:02:05 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:02:05 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:02:05 user nova-compute[75206]:     </rng>
Nov 29 22:02:05 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:02:05 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:02:05 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:02:05 user nova-compute[75206]:     </memballoon>
Nov 29 22:02:05 user nova-compute[75206]:   </devices>
Nov 29 22:02:05 user nova-compute[75206]: </domain>
Nov 29 22:02:05 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1444831382',display_name='tempest-TestServerVolumeAttachmentScenario-server-1444831382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1444831382',id=38,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZHYBJvdUAhW1+avxp4PP6A2k5NVxsiP6O3rHpsZzqZ6g9RB+GpolifkHZEs5rvECynJjhfTSqQ/NN+5gZmHvKSlh7DT/Sr5rIp3eEeGggUf1Qe0y6BvnEoYI8cuHbfew==',key_name='tempest-keypair-1183905999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2957ca1e73e846229fb7a95b5f44994d',ramdisk_id='',reservation_id='r-00a2wsr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1924217286',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1924217286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16af9212f6a8404cb84376f4b631feb1',uuid=e1e67b78-6589-4d67-b70f-96907954cb00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converting VIF {"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG os_vif [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1de1e017-92ac-5fb9-b5eb-50cf63c5c33d', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap483f2cab-10, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap483f2cab-10, col_values=(('qos', UUID('f91f4c42-cb57-4638-b179-8f54aa2aee08')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap483f2cab-10, col_values=(('external_ids', {'iface-id': '483f2cab-108a-4dd9-b2b7-ab9a188e0899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e5:44', 'vm-uuid': 'e1e67b78-6589-4d67-b70f-96907954cb00'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:05 user nova-compute[75206]: INFO os_vif [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10')
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:02:05 user nova-compute[75206]: INFO nova.compute.claims [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Claim successful on node user
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:02:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No VIF found with MAC fa:16:3e:e3:e5:44, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:06 user nova-compute[75206]: WARNING nova.compute.manager [req-cb002c4e-6944-46e2-b6a6-3b7876393162 req-603300f0-569d-4f17-b60e-fcca0b9508e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state active and task_state reboot_started.
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.network.neutron [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updated VIF entry in instance network info cache for port 483f2cab-108a-4dd9-b2b7-ab9a188e0899. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.network.neutron [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating instance_info_cache with network_info: [{"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-88d34d21-b78c-4219-8aa9-61505f64e9a5 req-4e70d4f3-f695-407f-9278-c37a79c0589d service nova] Releasing lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:02:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.policy [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d76d25d6a44ebcb76b81f7cdfcd46f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9082216936d747e8b7e4033b96299b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:06 user nova-compute[75206]: INFO nova.virt.block_device [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Booting with volume bffbb024-2bd9-4728-b6fc-d3ca3c2624fd at /dev/vda
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.utils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a40ba-b11e-44df-8e24-966b3323d7ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d26be3-11b6-4455-adfc-c6d7cb8fcdea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2a4d6-8dca-4fe5-b787-850e3d0c41d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab38c151-1802-4dbd-a5c0-4c609c9bf1eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:06 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:02:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7f312f-732c-4c0e-818d-0eb0f878e6ff]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG os_brick.utils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:06 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating existing volume attachment record: 9a1d3d22-8405-48bb-8f6d-457224e462a7 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:02:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Successfully created port: 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:02:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance shutdown successfully.
Nov 29 22:02:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Successfully updated port: 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing instance network info cache due to event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:08 user nova-compute[75206]: WARNING nova.compute.manager [req-8e1cb3eb-f835-4266-b25d-40d75511bd10 req-d7d9e33e-c594-4b99-93d7-3d431de749e2 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state active and task_state reboot_started.
Nov 29 22:02:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG nova.network.neutron [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance network_info: |[{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING nova.compute.manager [req-f26f18ce-6393-46ff-9661-d2138536ad99 req-651ffefb-5d83-4b21-aa3b-a3a7703dc8cb service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state building and task_state spawning.
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updated VIF entry in instance network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2b2c6eeb-0cd4-4c1f-9d19-d1839d7bc99e req-878d3a54-6ab0-4fd0-a00f-90c26d0da535 service nova] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state active and task_state reboot_started.
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING nova.compute.manager [req-803e4e64-db35-4862-938c-6f05957719ba req-094c7481-8885-4681-b978-f9580873dfa6 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state active and task_state reboot_started.
Nov 29 22:02:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:02:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Creating image(s)
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Ensure instance console log exists: /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start _get_guest_xml network_info=[{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5be472ed-798f-4ef2-8e34-6cbc11449e62', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '648e90b8-b0c6-4a64-ae14-d019848019d9', 'attached_at': '', 'detached_at': '', 'volume_id': '713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'serial': '713bc077-ce30-40d8-a8b7-3e17c4968b4c'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:10 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:10 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:10 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69cded-12f7-4478-9a83-cac73783e024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:02:10 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b85c39-dc33-4d3c-b972-c10efcf0913e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c] added
Nov 29 22:02:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514e346-0b16-494f-ba09-5e7f7d3a3d3f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a66d9-ef19-4b66-9621-e35a2aafc3a4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxmOHDdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxmOHDdg" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[367eca17-9d07-4420-8614-69257124d0d7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxmOHDdg'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7848aa-1e35-4e82-a5c3-d3727a2332f4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb541b-81ca-4ebe-9ed3-e693b3d04e20]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4ec22d-a92d-419c-acc8-239f389b386a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260]
Nov 29 22:02:11 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260] successful.
Nov 29 22:02:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e018fac-0436-46d9-a597-d1fe74b91b73]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad081cd5-0ace-46fb-b45a-8738457716df]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:11 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4071c0-69f7-4066-87f3-78b6f5014c0e]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Instance spawned successfully.
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.compute.manager [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Took 8.88 seconds to build instance.
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d8aa2c66-59b1-4972-a93c-9a222d30e98c tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.039s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.compute.claims [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Claim successful on node user
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance running successfully.
Nov 29 22:02:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance soft rebooted successfully.
Nov 29 22:02:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-942412b3-1068-4022-a829-9e88c3704a8a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.967s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23636356137633334', 'path': '/dev/sdf'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636356137633334', 'path': '/dev/sdf'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:12 user nova-compute[75206]: WARNING nova.compute.manager [req-0e150262-d2cc-4e06-85d3-0dd16f039594 req-1f7e7990-e960-4bcf-ac67-bdbe6325d808 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state active and task_state None.
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1746192216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1746192216',id=37,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-t3gust4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:01:50Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=648e90b8-b0c6-4a64-ae14-d019848019d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:02:12 user nova-compute[75206]:   <uuid>648e90b8-b0c6-4a64-ae14-d019848019d9</uuid>
Nov 29 22:02:12 user nova-compute[75206]:   <name>instance-00000025</name>
Nov 29 22:02:12 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:02:12 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:02:12 user nova-compute[75206]:   <metadata>
Nov 29 22:02:12 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:02:12 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1746192216</nova:name>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:02:10</nova:creationTime>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:02:12 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:02:12 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:owner>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 22:02:12 user nova-compute[75206]:       </nova:owner>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:02:12 user nova-compute[75206]:       <nova:ports>
Nov 29 22:02:12 user nova-compute[75206]:         <nova:port uuid="4a8928f1-cbe4-4d06-9570-173b2ed0e8c1">
Nov 29 22:02:12 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 22:02:12 user nova-compute[75206]:         </nova:port>
Nov 29 22:02:12 user nova-compute[75206]:       </nova:ports>
Nov 29 22:02:12 user nova-compute[75206]:     </nova:instance>
Nov 29 22:02:12 user nova-compute[75206]:   </metadata>
Nov 29 22:02:12 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:02:12 user nova-compute[75206]:     <system>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="serial">648e90b8-b0c6-4a64-ae14-d019848019d9</entry>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="uuid">648e90b8-b0c6-4a64-ae14-d019848019d9</entry>
Nov 29 22:02:12 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:02:12 user nova-compute[75206]:     </system>
Nov 29 22:02:12 user nova-compute[75206]:   </sysinfo>
Nov 29 22:02:12 user nova-compute[75206]:   <os>
Nov 29 22:02:12 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:02:12 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:02:12 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:02:12 user nova-compute[75206]:   </os>
Nov 29 22:02:12 user nova-compute[75206]:   <features>
Nov 29 22:02:12 user nova-compute[75206]:     <acpi/>
Nov 29 22:02:12 user nova-compute[75206]:     <apic/>
Nov 29 22:02:12 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:02:12 user nova-compute[75206]:   </features>
Nov 29 22:02:12 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:02:12 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:02:12 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:02:12 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:02:12 user nova-compute[75206]:   </clock>
Nov 29 22:02:12 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:02:12 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:02:12 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:02:12 user nova-compute[75206]:   </cpu>
Nov 29 22:02:12 user nova-compute[75206]:   <devices>
Nov 29 22:02:12 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:02:12 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:02:12 user nova-compute[75206]:       <source dev="/dev/sdf"/>
Nov 29 22:02:12 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:02:12 user nova-compute[75206]:       <serial>713bc077-ce30-40d8-a8b7-3e17c4968b4c</serial>
Nov 29 22:02:12 user nova-compute[75206]:     </disk>
Nov 29 22:02:12 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:02:12 user nova-compute[75206]:       <mac address="fa:16:3e:ee:f4:c1"/>
Nov 29 22:02:12 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:12 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:02:12 user nova-compute[75206]:       <target dev="tap4a8928f1-cb"/>
Nov 29 22:02:12 user nova-compute[75206]:     </interface>
Nov 29 22:02:12 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:02:12 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/console.log" append="off"/>
Nov 29 22:02:12 user nova-compute[75206]:     </serial>
Nov 29 22:02:12 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:02:12 user nova-compute[75206]:     <video>
Nov 29 22:02:12 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:12 user nova-compute[75206]:     </video>
Nov 29 22:02:12 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:02:12 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:02:12 user nova-compute[75206]:     </rng>
Nov 29 22:02:12 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:02:12 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:02:12 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:02:12 user nova-compute[75206]:     </memballoon>
Nov 29 22:02:12 user nova-compute[75206]:   </devices>
Nov 29 22:02:12 user nova-compute[75206]: </domain>
Nov 29 22:02:12 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1746192216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1746192216',id=37,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-t3gust4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:01:50Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=648e90b8-b0c6-4a64-ae14-d019848019d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG os_vif [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c25ddda2-2759-5835-aa2b-8fb4b874cd29', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a8928f1-cb, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a8928f1-cb, col_values=(('qos', UUID('290960bf-c3f8-4be3-9682-dff68ae8e042')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a8928f1-cb, col_values=(('external_ids', {'iface-id': '4a8928f1-cbe4-4d06-9570-173b2ed0e8c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f4:c1', 'vm-uuid': '648e90b8-b0c6-4a64-ae14-d019848019d9'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:12 user nova-compute[75206]: INFO os_vif [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb')
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:ee:f4:c1, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:02:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.policy [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd4014bdbbf4434ab64a764f95c5767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97782e20f03429793d463cae864c17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:02:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Creating image(s)
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "/opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "/opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "/opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.231s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk 1073741824" returned: 0 in 0.062s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Successfully created port: e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.264s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Cannot resize image /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Ensure instance console log exists: /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:14 user nova-compute[75206]: WARNING nova.compute.manager [req-19df9ef1-da01-4a70-b493-db44832e5a70 req-0a6eb3fa-4c3c-494f-98aa-60391dbbf9ac service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state building and task_state spawning.
Nov 29 22:02:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Successfully updated port: e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquired lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updating instance_info_cache with network_info: [{"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Releasing lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Instance network_info: |[{"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Start _get_guest_xml network_info=[{"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:02:15 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:15 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1928483505',display_name='tempest-VolumesSnapshotTestJSON-instance-1928483505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1928483505',id=40,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw5FZST02F/CgTDKqv9Vi7NVhpbiKs2T/9lrB9njap0Udw4ivj4EJTBzszmiQ4nZdG7Zn6YNoKXPzgNMy9MYlyrB8b8LVR0To4Ceauf67Co7p2xGtePYQXzI30+8zjeNw==',key_name='tempest-keypair-1768950190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-7q9mawi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=742b3d8a-d614-4c14-a04d-f000e97b4af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'pci_devices' on Instance uuid 742b3d8a-d614-4c14-a04d-f000e97b4af4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:02:15 user nova-compute[75206]:   <uuid>742b3d8a-d614-4c14-a04d-f000e97b4af4</uuid>
Nov 29 22:02:15 user nova-compute[75206]:   <name>instance-00000028</name>
Nov 29 22:02:15 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:02:15 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:02:15 user nova-compute[75206]:   <metadata>
Nov 29 22:02:15 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:02:15 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1928483505</nova:name>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:02:15</nova:creationTime>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:02:15 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:02:15 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:owner>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:user uuid="5cd4014bdbbf4434ab64a764f95c5767">tempest-VolumesSnapshotTestJSON-1635594989-project-member</nova:user>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:project uuid="c97782e20f03429793d463cae864c17f">tempest-VolumesSnapshotTestJSON-1635594989</nova:project>
Nov 29 22:02:15 user nova-compute[75206]:       </nova:owner>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:02:15 user nova-compute[75206]:       <nova:ports>
Nov 29 22:02:15 user nova-compute[75206]:         <nova:port uuid="e523b35a-eccb-48c0-82b9-f6206000d47e">
Nov 29 22:02:15 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 22:02:15 user nova-compute[75206]:         </nova:port>
Nov 29 22:02:15 user nova-compute[75206]:       </nova:ports>
Nov 29 22:02:15 user nova-compute[75206]:     </nova:instance>
Nov 29 22:02:15 user nova-compute[75206]:   </metadata>
Nov 29 22:02:15 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:02:15 user nova-compute[75206]:     <system>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="serial">742b3d8a-d614-4c14-a04d-f000e97b4af4</entry>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="uuid">742b3d8a-d614-4c14-a04d-f000e97b4af4</entry>
Nov 29 22:02:15 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:02:15 user nova-compute[75206]:     </system>
Nov 29 22:02:15 user nova-compute[75206]:   </sysinfo>
Nov 29 22:02:15 user nova-compute[75206]:   <os>
Nov 29 22:02:15 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:02:15 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:02:15 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:02:15 user nova-compute[75206]:   </os>
Nov 29 22:02:15 user nova-compute[75206]:   <features>
Nov 29 22:02:15 user nova-compute[75206]:     <acpi/>
Nov 29 22:02:15 user nova-compute[75206]:     <apic/>
Nov 29 22:02:15 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:02:15 user nova-compute[75206]:   </features>
Nov 29 22:02:15 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:02:15 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:02:15 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:02:15 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:02:15 user nova-compute[75206]:   </clock>
Nov 29 22:02:15 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:02:15 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:02:15 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:02:15 user nova-compute[75206]:   </cpu>
Nov 29 22:02:15 user nova-compute[75206]:   <devices>
Nov 29 22:02:15 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:02:15 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:02:15 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk"/>
Nov 29 22:02:15 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:02:15 user nova-compute[75206]:     </disk>
Nov 29 22:02:15 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:02:15 user nova-compute[75206]:       <mac address="fa:16:3e:05:23:f0"/>
Nov 29 22:02:15 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:15 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:02:15 user nova-compute[75206]:       <target dev="tape523b35a-ec"/>
Nov 29 22:02:15 user nova-compute[75206]:     </interface>
Nov 29 22:02:15 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:02:15 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/console.log" append="off"/>
Nov 29 22:02:15 user nova-compute[75206]:     </serial>
Nov 29 22:02:15 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:02:15 user nova-compute[75206]:     <video>
Nov 29 22:02:15 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:15 user nova-compute[75206]:     </video>
Nov 29 22:02:15 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:02:15 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:02:15 user nova-compute[75206]:     </rng>
Nov 29 22:02:15 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:02:15 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:02:15 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:02:15 user nova-compute[75206]:     </memballoon>
Nov 29 22:02:15 user nova-compute[75206]:   </devices>
Nov 29 22:02:15 user nova-compute[75206]: </domain>
Nov 29 22:02:15 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1928483505',display_name='tempest-VolumesSnapshotTestJSON-instance-1928483505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1928483505',id=40,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw5FZST02F/CgTDKqv9Vi7NVhpbiKs2T/9lrB9njap0Udw4ivj4EJTBzszmiQ4nZdG7Zn6YNoKXPzgNMy9MYlyrB8b8LVR0To4Ceauf67Co7p2xGtePYQXzI30+8zjeNw==',key_name='tempest-keypair-1768950190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-7q9mawi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=742b3d8a-d614-4c14-a04d-f000e97b4af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG os_vif [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0759e27c-5b43-51ee-80fc-9670f6a9dcc7', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape523b35a-ec, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape523b35a-ec, col_values=(('qos', UUID('c6c920f7-3a4d-4d24-af85-95025986ea66')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape523b35a-ec, col_values=(('external_ids', {'iface-id': 'e523b35a-eccb-48c0-82b9-f6206000d47e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:23:f0', 'vm-uuid': '742b3d8a-d614-4c14-a04d-f000e97b4af4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:15 user nova-compute[75206]: INFO os_vif [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec')
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:02:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No VIF found with MAC fa:16:3e:05:23:f0, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:02:16 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Creating image(s)
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Ensure instance console log exists: /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start _get_guest_xml network_info=[{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '9a1d3d22-8405-48bb-8f6d-457224e462a7', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'serial': 'bffbb024-2bd9-4728-b6fc-d3ca3c2624fd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:02:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:16 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:16 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:16 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:16 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b759f2-604b-450a-89e9-509785d3964b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:02:16 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be1f5d-81a1-4657-84a1-e570b4b69aa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd] added
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e48f7-e5e2-4507-87ff-088cd5dc2f62]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3439e9-16ba-4148-9947-f35d7d958a69]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQIuEygh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance spawned successfully.
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQIuEygh" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[653e1d23-1d20-4cac-b524-98a992d91330]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQIuEygh'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-changed-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Refreshing instance network info cache due to event network-changed-e523b35a-eccb-48c0-82b9-f6206000d47e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Acquiring lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Acquired lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.network.neutron [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Refreshing network info cache for port e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f62120-c0f5-4d5c-b0d8-4d10cbe1ba74]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e9e381-0309-4f5a-b0e0-e7b3bf82c647]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: INFO nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 29 22:02:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038f44d-75cd-4ae3-b2dd-cf04f9e88e0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]
Nov 29 22:02:16 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:16 user nova-compute[75206]: INFO nova.compute.manager [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Took 27.87 seconds to build instance.
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c4474a-530d-43b8-8097-e20a069aed1c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e1d8925c-8015-48d3-8a38-cc586a5bd146 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.998s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.364s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:16 user nova-compute[75206]: INFO nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5144fd91-bc06-44f5-b799-32197ffc00b5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:16 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:02:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04038e5c-b4f8-4e75-bc5e-bbf352ccbd7b]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG nova.network.neutron [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updated VIF entry in instance network info cache for port e523b35a-eccb-48c0-82b9-f6206000d47e. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG nova.network.neutron [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updating instance_info_cache with network_info: [{"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Releasing lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:17 user nova-compute[75206]: WARNING nova.compute.manager [req-088a6ad7-01f6-4502-9e7f-e17ac0864af0 req-34794d40-fc38-43b9-8dd2-285f0968818b service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state building and task_state spawning.
Nov 29 22:02:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23337303735663334', 'path': '/dev/sdg'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303735663334', 'path': '/dev/sdg'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGF540cV/0ZM0hiFndiPUc2lnIxULHMgn2agKvc9uCojVqUaqEf4eDF+KtkQiDQSxpQSL5bygWcXo3Qg3L7tHi4pPv6GLyOxXgBEJ+4JxEeIeEsqRYygb1s1SHpDa4IJ3g==',key_name='tempest-TestShelveInstance-381264103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:07Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.objects.instance [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'pci_devices' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:02:18 user nova-compute[75206]:   <uuid>69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</uuid>
Nov 29 22:02:18 user nova-compute[75206]:   <name>instance-00000027</name>
Nov 29 22:02:18 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:02:18 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:02:18 user nova-compute[75206]:   <metadata>
Nov 29 22:02:18 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:02:18 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:02:18 user nova-compute[75206]:       <nova:name>tempest-TestShelveInstance-server-1900707054</nova:name>
Nov 29 22:02:18 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:02:16</nova:creationTime>
Nov 29 22:02:18 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:02:18 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:02:18 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:02:18 user nova-compute[75206]:       <nova:owner>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:user uuid="96d76d25d6a44ebcb76b81f7cdfcd46f">tempest-TestShelveInstance-2054918139-project-member</nova:user>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:project uuid="9082216936d747e8b7e4033b96299b55">tempest-TestShelveInstance-2054918139</nova:project>
Nov 29 22:02:18 user nova-compute[75206]:       </nova:owner>
Nov 29 22:02:18 user nova-compute[75206]:       <nova:ports>
Nov 29 22:02:18 user nova-compute[75206]:         <nova:port uuid="75a20a21-ef92-4fb4-9625-ae61ff9a7a24">
Nov 29 22:02:18 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 22:02:18 user nova-compute[75206]:         </nova:port>
Nov 29 22:02:18 user nova-compute[75206]:       </nova:ports>
Nov 29 22:02:18 user nova-compute[75206]:     </nova:instance>
Nov 29 22:02:18 user nova-compute[75206]:   </metadata>
Nov 29 22:02:18 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:02:18 user nova-compute[75206]:     <system>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="serial">69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</entry>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="uuid">69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</entry>
Nov 29 22:02:18 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:02:18 user nova-compute[75206]:     </system>
Nov 29 22:02:18 user nova-compute[75206]:   </sysinfo>
Nov 29 22:02:18 user nova-compute[75206]:   <os>
Nov 29 22:02:18 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:02:18 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:02:18 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:02:18 user nova-compute[75206]:   </os>
Nov 29 22:02:18 user nova-compute[75206]:   <features>
Nov 29 22:02:18 user nova-compute[75206]:     <acpi/>
Nov 29 22:02:18 user nova-compute[75206]:     <apic/>
Nov 29 22:02:18 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:02:18 user nova-compute[75206]:   </features>
Nov 29 22:02:18 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:02:18 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:02:18 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:02:18 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:02:18 user nova-compute[75206]:   </clock>
Nov 29 22:02:18 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:02:18 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:02:18 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:02:18 user nova-compute[75206]:   </cpu>
Nov 29 22:02:18 user nova-compute[75206]:   <devices>
Nov 29 22:02:18 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:02:18 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:02:18 user nova-compute[75206]:       <source dev="/dev/sdg"/>
Nov 29 22:02:18 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:02:18 user nova-compute[75206]:       <serial>bffbb024-2bd9-4728-b6fc-d3ca3c2624fd</serial>
Nov 29 22:02:18 user nova-compute[75206]:     </disk>
Nov 29 22:02:18 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:02:18 user nova-compute[75206]:       <mac address="fa:16:3e:5d:28:9a"/>
Nov 29 22:02:18 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:18 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:02:18 user nova-compute[75206]:       <target dev="tap75a20a21-ef"/>
Nov 29 22:02:18 user nova-compute[75206]:     </interface>
Nov 29 22:02:18 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:02:18 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4/console.log" append="off"/>
Nov 29 22:02:18 user nova-compute[75206]:     </serial>
Nov 29 22:02:18 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:02:18 user nova-compute[75206]:     <video>
Nov 29 22:02:18 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:18 user nova-compute[75206]:     </video>
Nov 29 22:02:18 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:02:18 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:02:18 user nova-compute[75206]:     </rng>
Nov 29 22:02:18 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:02:18 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:02:18 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:02:18 user nova-compute[75206]:     </memballoon>
Nov 29 22:02:18 user nova-compute[75206]:   </devices>
Nov 29 22:02:18 user nova-compute[75206]: </domain>
Nov 29 22:02:18 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGF540cV/0ZM0hiFndiPUc2lnIxULHMgn2agKvc9uCojVqUaqEf4eDF+KtkQiDQSxpQSL5bygWcXo3Qg3L7tHi4pPv6GLyOxXgBEJ+4JxEeIeEsqRYygb1s1SHpDa4IJ3g==',key_name='tempest-TestShelveInstance-381264103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:07Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG os_vif [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4a8c1eb-cc54-5e24-9133-c571b9ae9019', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a20a21-ef, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a20a21-ef, col_values=(('qos', UUID('c2e4d563-7748-423a-a29d-c7833dd0644f')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a20a21-ef, col_values=(('external_ids', {'iface-id': '75a20a21-ef92-4fb4-9625-ae61ff9a7a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:28:9a', 'vm-uuid': '69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:18 user nova-compute[75206]: INFO os_vif [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef')
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] No VIF found with MAC fa:16:3e:5d:28:9a, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] No waiting events found dispatching network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:18 user nova-compute[75206]: WARNING nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received unexpected event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e for instance with vm_state building and task_state spawning.
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] No waiting events found dispatching network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:18 user nova-compute[75206]: WARNING nova.compute.manager [req-a8f8fe8a-ba92-4a23-9e35-e4f0c1382c66 req-09138c08-79af-4f0b-8635-761da93ed098 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received unexpected event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e for instance with vm_state building and task_state spawning.
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:02:19 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Instance spawned successfully.
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:19 user nova-compute[75206]: INFO nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 29 22:02:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:19 user nova-compute[75206]: INFO nova.compute.manager [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Took 8.03 seconds to build instance.
Nov 29 22:02:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e6b835d-77ec-4e54-a3db-d2c382c7bfd1 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.158s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:20 user nova-compute[75206]: WARNING nova.compute.manager [req-e24d188f-3e8e-4aea-b367-3188536a3115 req-8565ca95-526a-4d0f-9338-2ecb31fe4742 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state building and task_state spawning.
Nov 29 22:02:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.compute.manager [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:22 user nova-compute[75206]: WARNING nova.compute.manager [req-0cd9ef7a-c478-4e3c-b9ee-c973c685ba73 req-c1e42c52-de4b-4896-bb8e-03d71e2ef9e9 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state building and task_state spawning.
Nov 29 22:02:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance spawned successfully.
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:02:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:22 user nova-compute[75206]: INFO nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 29 22:02:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:02:22 user nova-compute[75206]: INFO nova.compute.manager [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Took 16.69 seconds to build instance.
Nov 29 22:02:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-213ced23-b28c-46b8-af60-8eb81a6e25af tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.869s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing instance network info cache due to event network-changed-ad856788-4434-42d5-b2c1-dfd545ff286f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Refreshing network info cache for port ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updated VIF entry in instance network info cache for port ad856788-4434-42d5-b2c1-dfd545ff286f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG nova.network.neutron [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6145cbbd-3226-46f0-b57f-b0965e4360a6 req-7650a822-6cb9-4c22-afcb-f0aacd27f7d1 service nova] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Stashing vm_state: active {{(pid=75206) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-changed-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Refreshing instance network info cache due to event network-changed-7453adc6-895e-4bd0-8cdf-8e554a65ada7. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Refreshing network info cache for port 7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:02:25 user nova-compute[75206]: INFO nova.compute.claims [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Claim successful on node user
Nov 29 22:02:25 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating resource usage from migration 2c5652c6-bec0-44e8-9284-c74107be8c3e
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updated VIF entry in instance network info cache for port 7453adc6-895e-4bd0-8cdf-8e554a65ada7. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a87227d1-8535-4ec1-a3a6-7db8c14f5ce7 req-950925e5-2eb8-4ba5-8412-7a0f7c961fc3 service nova] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:02:25 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.675s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:26 user nova-compute[75206]: INFO nova.compute.manager [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Migrating
Nov 29 22:02:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Starting migrate_disk_and_power_off {{(pid=75206) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.compute.manager [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:27 user nova-compute[75206]: WARNING nova.compute.manager [req-15ae196f-516e-4a30-8a22-0d01b294e945 req-7bc88586-714e-4f4f-8eb7-8606059850b3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance destroyed successfully.
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7453adc6-89, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=985cdadc-3752-41ab-ae78-7e98e6b6bbad) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: INFO os_vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89')
Nov 29 22:02:27 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:27 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[498120e7-43ee-4ee4-8b85-83b90898e29d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:02:27 user nova-compute[75206]: No targets found.
Nov 29 22:02:27 user nova-compute[75206]: iSNS:
Nov 29 22:02:27 user nova-compute[75206]: No targets found.
Nov 29 22:02:27 user nova-compute[75206]: STATIC:
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:02:27 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:02:27 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:02:27 user nova-compute[75206]: FIRMWARE:
Nov 29 22:02:27 user nova-compute[75206]: No targets found.
Nov 29 22:02:27 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:02:27 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:02:27 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751688b-11a1-412f-bf95-5f6b9f999310]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55576756-1a05-4cab-9e2f-b06512c14d46]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:27 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:27 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:27 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c81e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a79c40-e2e8-4fdd-84b1-8365237aad96]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.046s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4a00b-d55c-414c-8a1f-79c8c0941622]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc31e2a-5bcd-469d-a5e5-541a908948fc]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:02:27 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.188s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e304c31-7e96-47f5-8d73-017365a9acb0]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b138b78',) {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 22:02:28 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2b138b78
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3782db-a6a3-4edb-a03f-4e455aa3828d]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c26ce-c69f-44ca-833b-0b7121a4cd4a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61318c12-4d5c-43da-ace4-613939934dfc]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]
Nov 29 22:02:28 user nova-compute[75206]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.
Nov 29 22:02:28 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff50ea-6a5e-4ed1-a4dc-d8e7c5b868c3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.721s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== disconnect_volume: return (723ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:29 user nova-compute[75206]: WARNING nova.compute.manager [req-4053b7b9-2aae-4496-b1aa-6625629d22b5 req-76a8f875-240e-4e92-beda-2e7a6ac89427 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_migrating.
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Port 7453adc6-895e-4bd0-8cdf-8e554a65ada7 binding to destination host user is already ACTIVE {{(pid=75206) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.utils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff82ddb8-1ee2-40c0-8669-0beb9cd42fb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1240f7-91ce-4403-b4de-aa86a22bf891]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db278d23-0720-4726-a862-2dd936e3a85e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908590a-6b1b-4d5b-b7e1-51be787844f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:02:30 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d3b26-f568-4b7e-9d87-66e092ff61b8]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG os_brick.utils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=24.79114532470703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Applying migration context for instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f as it has an incoming, in-progress migration 2c5652c6-bec0-44e8-9284-c74107be8c3e. Migration status is post-migrating {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 22:02:33 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating resource usage from migration 2c5652c6-bec0-44e8-9284-c74107be8c3e
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 0c62b909-1f4f-4fec-a4c1-c330379083de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 648e90b8-b0c6-4a64-ae14-d019848019d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e1e67b78-6589-4d67-b70f-96907954cb00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 742b3d8a-d614-4c14-a04d-f000e97b4af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Migration 2c5652c6-bec0-44e8-9284-c74107be8c3e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:02:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:02:38 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [{"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Starting finish_migration {{(pid=75206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 22:02:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Creating image(s)
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Ensure instance console log exists: /opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start _get_guest_xml network_info=[{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'cde7484a-91b2-446e-84b0-8e19216676ec', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '47df4638-2c13-4c33-8b8d-f7a5d5d3338f', 'attached_at': '2023-11-29T22:02:40.000000', 'detached_at': '', 'volume_id': '554084b0-93f5-4a09-b74b-ecdb4e78779c', 'serial': '554084b0-93f5-4a09-b74b-ecdb4e78779c'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:02:40 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:40 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:02:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:40 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:02:40 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ecc5f-960b-4cc8-97a7-33ed3ff1a754]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:02:40 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efdd6ca-77d6-4e85-94e0-4c936ebfcefc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c] added
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aae3d0-e368-49aa-95b6-087e4922eb03]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb8c1e-6351-41fa-8bff-af8cd720335e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLPHXVED {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLPHXVED" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e13766-c177-470d-baac-3c40acacb504]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLPHXVED'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[266ac1b5-628e-4ff3-b77b-07950a5d798a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d14d2-5493-442b-83cc-052573fc5de6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[944fd8f4-df44-43b0-aa72-549ca3a4e4f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]
Nov 29 22:02:40 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cb20b-15ef-41cb-8419-91988cc17224]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1985eab9-9cb0-453b-97a5-ce18dde44ebf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:02:40 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:02:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc49f104-df43-4ece-b454-180d33b1cc1a]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:02:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23034643638383061', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034643638383061', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:02:41 user nova-compute[75206]:   <uuid>47df4638-2c13-4c33-8b8d-f7a5d5d3338f</uuid>
Nov 29 22:02:41 user nova-compute[75206]:   <name>instance-00000024</name>
Nov 29 22:02:41 user nova-compute[75206]:   <memory>2097152</memory>
Nov 29 22:02:41 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:02:41 user nova-compute[75206]:   <metadata>
Nov 29 22:02:41 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:02:41 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:02:41 user nova-compute[75206]:       <nova:name>tempest-ServerActionsTestOtherA-server-358814846</nova:name>
Nov 29 22:02:41 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:02:40</nova:creationTime>
Nov 29 22:02:41 user nova-compute[75206]:       <nova:flavor name="m1.small">
Nov 29 22:02:41 user nova-compute[75206]:         <nova:memory>2048</nova:memory>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:disk>20</nova:disk>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:02:41 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:02:41 user nova-compute[75206]:       <nova:owner>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:user uuid="656a5b2470e14813b3060d41b1d61095">tempest-ServerActionsTestOtherA-2043072317-project-member</nova:user>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:project uuid="feaa0640f6b84a71b856782e45ca4adf">tempest-ServerActionsTestOtherA-2043072317</nova:project>
Nov 29 22:02:41 user nova-compute[75206]:       </nova:owner>
Nov 29 22:02:41 user nova-compute[75206]:       <nova:ports>
Nov 29 22:02:41 user nova-compute[75206]:         <nova:port uuid="7453adc6-895e-4bd0-8cdf-8e554a65ada7">
Nov 29 22:02:41 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 22:02:41 user nova-compute[75206]:         </nova:port>
Nov 29 22:02:41 user nova-compute[75206]:       </nova:ports>
Nov 29 22:02:41 user nova-compute[75206]:     </nova:instance>
Nov 29 22:02:41 user nova-compute[75206]:   </metadata>
Nov 29 22:02:41 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:02:41 user nova-compute[75206]:     <system>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="serial">47df4638-2c13-4c33-8b8d-f7a5d5d3338f</entry>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="uuid">47df4638-2c13-4c33-8b8d-f7a5d5d3338f</entry>
Nov 29 22:02:41 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:02:41 user nova-compute[75206]:     </system>
Nov 29 22:02:41 user nova-compute[75206]:   </sysinfo>
Nov 29 22:02:41 user nova-compute[75206]:   <os>
Nov 29 22:02:41 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:02:41 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:02:41 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:02:41 user nova-compute[75206]:   </os>
Nov 29 22:02:41 user nova-compute[75206]:   <features>
Nov 29 22:02:41 user nova-compute[75206]:     <acpi/>
Nov 29 22:02:41 user nova-compute[75206]:     <apic/>
Nov 29 22:02:41 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:02:41 user nova-compute[75206]:   </features>
Nov 29 22:02:41 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:02:41 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:02:41 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:02:41 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:02:41 user nova-compute[75206]:   </clock>
Nov 29 22:02:41 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:02:41 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:02:41 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:02:41 user nova-compute[75206]:   </cpu>
Nov 29 22:02:41 user nova-compute[75206]:   <devices>
Nov 29 22:02:41 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:02:41 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:02:41 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 22:02:41 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:02:41 user nova-compute[75206]:       <serial>554084b0-93f5-4a09-b74b-ecdb4e78779c</serial>
Nov 29 22:02:41 user nova-compute[75206]:     </disk>
Nov 29 22:02:41 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:02:41 user nova-compute[75206]:       <mac address="fa:16:3e:b2:ed:ac"/>
Nov 29 22:02:41 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:41 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:02:41 user nova-compute[75206]:       <target dev="tap7453adc6-89"/>
Nov 29 22:02:41 user nova-compute[75206]:     </interface>
Nov 29 22:02:41 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:02:41 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f/console.log" append="off"/>
Nov 29 22:02:41 user nova-compute[75206]:     </serial>
Nov 29 22:02:41 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:02:41 user nova-compute[75206]:     <video>
Nov 29 22:02:41 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:02:41 user nova-compute[75206]:     </video>
Nov 29 22:02:41 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:02:41 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:02:41 user nova-compute[75206]:     </rng>
Nov 29 22:02:41 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:02:41 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:02:41 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:02:41 user nova-compute[75206]:     </memballoon>
Nov 29 22:02:41 user nova-compute[75206]:   </devices>
Nov 29 22:02:41 user nova-compute[75206]: </domain>
Nov 29 22:02:41 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1766499051-network", "vif_mac": "fa:16:3e:b2:ed:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG os_vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '363b1f19-bdcb-5aec-87e8-17242e9ce4c3', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7453adc6-89, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7453adc6-89, col_values=(('qos', UUID('4107a27f-feb1-4486-80c3-22fef53e0bfc')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7453adc6-89, col_values=(('external_ids', {'iface-id': '7453adc6-895e-4bd0-8cdf-8e554a65ada7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ed:ac', 'vm-uuid': '47df4638-2c13-4c33-8b8d-f7a5d5d3338f'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:41 user nova-compute[75206]: INFO os_vif [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89')
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:02:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] No VIF found with MAC fa:16:3e:b2:ed:ac, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:02:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:43 user nova-compute[75206]: WARNING nova.compute.manager [req-55544712-acce-4e6e-b41e-b4c250f5a804 req-e3fdaec8-21f5-4fc3-8ec6-8518d1fa4342 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_finish.
Nov 29 22:02:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:02:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance running successfully.
Nov 29 22:02:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Failed to set time: agent not configured {{(pid=75206) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5b982f9d-5f08-4b9e-9a60-5cfb2f3fb22a tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] finish_migration finished successfully. {{(pid=75206) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:02:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:02:45 user nova-compute[75206]: WARNING nova.compute.manager [req-4d4f3359-92cb-46f1-8bd3-1fcb1c3578a0 req-53216223-b5e2-4d7f-8384-eccb5645b3ef service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state resize_finish.
Nov 29 22:02:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:02:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:16 user nova-compute[75206]: INFO nova.compute.manager [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Unrescuing
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'flavor' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:16 user nova-compute[75206]: WARNING nova.compute.manager [req-386209f6-550d-42cc-b65a-418dbdf48523 req-5fec1b2f-fbfc-4439-8d8a-4cf30d36bf95 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:03:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance destroyed successfully.
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:18 user nova-compute[75206]: WARNING nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:03:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:18 user nova-compute[75206]: WARNING nova.compute.manager [req-394b26af-d5f4-4702-a6f2-e98e0f875fdf req-eda623b1-7aa8-448e-80a0-5360f726a210 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:03:20 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b6f188b6-3022-4a88-aa4c-129ea9ab771a tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:03:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:21 user nova-compute[75206]: WARNING nova.compute.manager [req-c0f9b3ee-265e-4bc1-9c9f-86fb39c857fe req-d1e5b5e0-2cb8-4e7a-bb3f-e103d94a7901 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state None.
Nov 29 22:03:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7122MB free_disk=24.759227752685547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Applying migration context for instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f as it has an incoming, in-progress migration 2c5652c6-bec0-44e8-9284-c74107be8c3e. Migration status is finished {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 22:03:32 user nova-compute[75206]: INFO nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating resource usage from migration 2c5652c6-bec0-44e8-9284-c74107be8c3e
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 0c62b909-1f4f-4fec-a4c1-c330379083de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 648e90b8-b0c6-4a64-ae14-d019848019d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e1e67b78-6589-4d67-b70f-96907954cb00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 742b3d8a-d614-4c14-a04d-f000e97b4af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Migration 2c5652c6-bec0-44e8-9284-c74107be8c3e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:03:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:03:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:03:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:03:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:03:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [{"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-4f8772b2-6486-4082-b9f1-962b13cda528" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:03:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:35 user nova-compute[75206]: INFO nova.compute.manager [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Unshelving
Nov 29 22:03:35 user nova-compute[75206]: INFO nova.virt.block_device [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Booting with volume a22f728f-4e0a-4c01-ac2c-375c0927a2c2 at /dev/vdc
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5894d13-5b8c-4822-a01e-4a81ecdc0720]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb14dba4-7d95-4266-a8a4-02b896141e7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50590a3b-be1d-4a2e-9906-6d6c6f59ca58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[775df9b1-55aa-4cfc-be19-578254252678]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:03:35 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:03:35 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbac624-bd7a-413a-b2ba-ec4cefa25b49]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG os_brick.utils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:03:35 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating existing volume attachment record: 25a7e572-838f-4fd8-98d9-c18dbd9744fd {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:03:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:03:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:39 user nova-compute[75206]: INFO nova.compute.manager [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Rescuing
Nov 29 22:03:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating instance_info_cache with network_info: [{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.compute.manager [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:40 user nova-compute[75206]: WARNING nova.compute.manager [req-67f1192f-e9ce-492f-bef4-c239598f1cf6 req-f63d76b0-9a79-4bd0-8a49-9e3cc3211517 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state rescuing.
Nov 29 22:03:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance destroyed successfully.
Nov 29 22:03:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Attempting a stable device rescue
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75206) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance directory exists: not creating {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 22:03:40 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Creating image(s)
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'trusted_certs' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "2220e19d129301ac46ab1973392427787abc2d10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "2220e19d129301ac46ab1973392427787abc2d10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:03:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.images [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] 5364191e-9bdb-449d-a2c3-37da927f7f0b was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.part /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.part /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.converted" returned: 0 in 0.316s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:42 user nova-compute[75206]: WARNING nova.compute.manager [req-a5be654a-e4d3-46f1-b0fc-ecc269ee4d42 req-18d37410-68ab-4088-861a-3832442ab7e1 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state rescuing.
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "2220e19d129301ac46ab1973392427787abc2d10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.605s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "2220e19d129301ac46ab1973392427787abc2d10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "2220e19d129301ac46ab1973392427787abc2d10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10 --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10,backing_fmt=raw /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10,backing_fmt=raw /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue" returned: 0 in 0.049s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "2220e19d129301ac46ab1973392427787abc2d10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'migration_context' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<648e90b8-b0c6-4a64-ae14-d019848019d9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start _get_guest_xml network_info=[{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:ee:f4:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5364191e-9bdb-449d-a2c3-37da927f7f0b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5be472ed-798f-4ef2-8e34-6cbc11449e62', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '648e90b8-b0c6-4a64-ae14-d019848019d9', 'attached_at': '', 'detached_at': '', 'volume_id': '713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'serial': '713bc077-ce30-40d8-a8b7-3e17c4968b4c'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<648e90b8-b0c6-4a64-ae14-d019848019d9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'numa_topology' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<648e90b8-b0c6-4a64-ae14-d019848019d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'vcpu_model' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.objects.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<648e90b8-b0c6-4a64-ae14-d019848019d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:03:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:03:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:03:42 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544537a-4110-4845-a28e-749110acdfb6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YxmOHDdg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 22:03:42 user nova-compute[75206]: node.name = iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:03:42 user nova-compute[75206]: node.tpgt = -1
Nov 29 22:03:42 user nova-compute[75206]: node.startup = automatic
Nov 29 22:03:42 user nova-compute[75206]: node.leading_login = No
Nov 29 22:03:42 user nova-compute[75206]: iface.iscsi_ifacename = default
Nov 29 22:03:42 user nova-compute[75206]: iface.net_ifacename = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.ipaddress = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.prefix_len = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.hwaddress = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.transport_name = tcp
Nov 29 22:03:42 user nova-compute[75206]: iface.initiatorname = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.vlan_id = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.vlan_priority = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.vlan_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.iface_num = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.mtu = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.port = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.bootproto = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.subnet_mask = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.gateway = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_alt_client_id = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_dns = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_learn_iqn = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_vendor_id_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_vendor_id = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.dhcp_slp_da = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.fragmentation = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.gratuitous_arp = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.incoming_forwarding = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.tos_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.tos = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.ttl = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.delayed_ack = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.tcp_nagle = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.tcp_wsf_state = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.tcp_wsf = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.tcp_timer_scale = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.tcp_timestamp = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.redirect = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.def_task_mgmt_timeout = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.header_digest = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.data_digest = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.immediate_data = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.initial_r2t = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.data_seq_inorder = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.data_pdu_inorder = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.erl = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.max_receive_data_len = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.first_burst_len = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.max_outstanding_r2t = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.max_burst_len = 0
Nov 29 22:03:42 user nova-compute[75206]: iface.chap_auth = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.bidi_chap = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.strict_login_compliance = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.discovery_auth = <empty>
Nov 29 22:03:42 user nova-compute[75206]: iface.discovery_logout = <empty>
Nov 29 22:03:42 user nova-compute[75206]: node.discovery_address = <empty>
Nov 29 22:03:42 user nova-compute[75206]: node.discovery_port = 0
Nov 29 22:03:42 user nova-compute[75206]: node.discovery_type = static
Nov 29 22:03:42 user nova-compute[75206]: node.session.initial_cmdsn = 0
Nov 29 22:03:42 user nova-compute[75206]: node.session.initial_login_retry_max = 8
Nov 29 22:03:42 user nova-compute[75206]: node.session.xmit_thread_priority = -20
Nov 29 22:03:42 user nova-compute[75206]: node.session.cmds_max = 128
Nov 29 22:03:42 user nova-compute[75206]: node.session.queue_depth = 32
Nov 29 22:03:42 user nova-compute[75206]: node.session.nr_sessions = 1
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.authmethod = CHAP
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.username = YxmOHDdg
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.password = ***
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.username_in = <empty>
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.password_in = <empty>
Nov 29 22:03:42 user nova-compute[75206]: node.session.auth.chap_algs = MD5
Nov 29 22:03:42 user nova-compute[75206]: node.session.timeo.replacement_timeout = 120
Nov 29 22:03:42 user nova-compute[75206]: node.session.err_timeo.abort_timeout = 15
Nov 29 22:03:42 user nova-compute[75206]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 22:03:42 user nova-compute[75206]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 22:03:42 user nova-compute[75206]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.FastAbort = Yes
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.InitialR2T = No
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.ImmediateData = Yes
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.MaxConnections = 1
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 22:03:42 user nova-compute[75206]: node.session.iscsi.ERL = 0
Nov 29 22:03:42 user nova-compute[75206]: node.session.scan = manual
Nov 29 22:03:42 user nova-compute[75206]: node.session.reopen_max = 0
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].address = 172.16.0.220
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].port = 3260
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].startup = manual
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].tcp.window_size = 524288
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].tcp.type_of_service = 0
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].timeo.logout_timeout = 15
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].timeo.login_timeout = 15
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].timeo.auth_timeout = 45
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.DataDigest = None
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.IFMarker = No
Nov 29 22:03:42 user nova-compute[75206]: node.conn[0].iscsi.OFMarker = No
Nov 29 22:03:42 user nova-compute[75206]: # END RECORD
Nov 29 22:03:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f00d86-1736-4905-9f6e-6409cc6be68f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c5822-ba5b-463b-9565-c43524272fbf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxmOHDdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxmOHDdg" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c615a2-13c5-4a29-9b5a-b95bb2114149]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxmOHDdg'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c4fad-1813-4baf-87c0-27c2df3c29b6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1196ab66-7e98-4171-b305-fc639c7b911e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:43 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:43 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:43 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] HCTL ('37', '0', '0', 0) found on session 37 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad59e2-cb66-41dc-9149-ea8f58e71d97]: (4, ('0 0 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Searching for a device in session 37 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23636356137633334', 'path': '/dev/sdf'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636356137633334', 'path': '/dev/sdf'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1746192216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1746192216',id=37,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-t3gust4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:02:17Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=648e90b8-b0c6-4a64-ae14-d019848019d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:ee:f4:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "vif_mac": "fa:16:3e:ee:f4:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'pci_devices' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.objects.base [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Object Instance<648e90b8-b0c6-4a64-ae14-d019848019d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:03:43 user nova-compute[75206]:   <uuid>648e90b8-b0c6-4a64-ae14-d019848019d9</uuid>
Nov 29 22:03:43 user nova-compute[75206]:   <name>instance-00000025</name>
Nov 29 22:03:43 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:03:43 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:03:43 user nova-compute[75206]:   <metadata>
Nov 29 22:03:43 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:03:43 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1746192216</nova:name>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:03:42</nova:creationTime>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:03:43 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:03:43 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:owner>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:user uuid="d79424ddb3af406d9ed8a1626a8f03ee">tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member</nova:user>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:project uuid="a5ffcb36d26c41cd99ccb16570f285dc">tempest-ServerBootFromVolumeStableRescueTest-1359036287</nova:project>
Nov 29 22:03:43 user nova-compute[75206]:       </nova:owner>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:03:43 user nova-compute[75206]:       <nova:ports>
Nov 29 22:03:43 user nova-compute[75206]:         <nova:port uuid="4a8928f1-cbe4-4d06-9570-173b2ed0e8c1">
Nov 29 22:03:43 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 22:03:43 user nova-compute[75206]:         </nova:port>
Nov 29 22:03:43 user nova-compute[75206]:       </nova:ports>
Nov 29 22:03:43 user nova-compute[75206]:     </nova:instance>
Nov 29 22:03:43 user nova-compute[75206]:   </metadata>
Nov 29 22:03:43 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:03:43 user nova-compute[75206]:     <system>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="serial">648e90b8-b0c6-4a64-ae14-d019848019d9</entry>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="uuid">648e90b8-b0c6-4a64-ae14-d019848019d9</entry>
Nov 29 22:03:43 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:03:43 user nova-compute[75206]:     </system>
Nov 29 22:03:43 user nova-compute[75206]:   </sysinfo>
Nov 29 22:03:43 user nova-compute[75206]:   <os>
Nov 29 22:03:43 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:03:43 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:03:43 user nova-compute[75206]:   </os>
Nov 29 22:03:43 user nova-compute[75206]:   <features>
Nov 29 22:03:43 user nova-compute[75206]:     <acpi/>
Nov 29 22:03:43 user nova-compute[75206]:     <apic/>
Nov 29 22:03:43 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:03:43 user nova-compute[75206]:   </features>
Nov 29 22:03:43 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:03:43 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:03:43 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:03:43 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:03:43 user nova-compute[75206]:   </clock>
Nov 29 22:03:43 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:03:43 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:03:43 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:03:43 user nova-compute[75206]:   </cpu>
Nov 29 22:03:43 user nova-compute[75206]:   <devices>
Nov 29 22:03:43 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:03:43 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:03:43 user nova-compute[75206]:       <source dev="/dev/sdf"/>
Nov 29 22:03:43 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:03:43 user nova-compute[75206]:       <serial>713bc077-ce30-40d8-a8b7-3e17c4968b4c</serial>
Nov 29 22:03:43 user nova-compute[75206]:     </disk>
Nov 29 22:03:43 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:03:43 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:03:43 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue"/>
Nov 29 22:03:43 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 22:03:43 user nova-compute[75206]:       <boot order="1"/>
Nov 29 22:03:43 user nova-compute[75206]:     </disk>
Nov 29 22:03:43 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:03:43 user nova-compute[75206]:       <mac address="fa:16:3e:ee:f4:c1"/>
Nov 29 22:03:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:03:43 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:03:43 user nova-compute[75206]:       <target dev="tap4a8928f1-cb"/>
Nov 29 22:03:43 user nova-compute[75206]:     </interface>
Nov 29 22:03:43 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:03:43 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/console.log" append="off"/>
Nov 29 22:03:43 user nova-compute[75206]:     </serial>
Nov 29 22:03:43 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:03:43 user nova-compute[75206]:     <video>
Nov 29 22:03:43 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:03:43 user nova-compute[75206]:     </video>
Nov 29 22:03:43 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:03:43 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:03:43 user nova-compute[75206]:     </rng>
Nov 29 22:03:43 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:03:43 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:03:43 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:03:43 user nova-compute[75206]:     </memballoon>
Nov 29 22:03:43 user nova-compute[75206]:   </devices>
Nov 29 22:03:43 user nova-compute[75206]: </domain>
Nov 29 22:03:43 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:03:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance destroyed successfully.
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:03:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] No VIF found with MAC fa:16:3e:ee:f4:c1, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_requests' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'numa_topology' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:03:44 user nova-compute[75206]: INFO nova.compute.claims [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Claim successful on node user
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:44 user nova-compute[75206]: WARNING nova.compute.manager [req-54ac1505-a121-41e3-8808-9216127a83b8 req-285e91a7-5f8f-4a57-a0d0-115e98aecbc7 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state rescuing.
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:03:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:44 user nova-compute[75206]: INFO nova.network.neutron [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating port ec0d31a2-a6f7-4d7f-b998-96b5730c9150 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:03:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Creating image(s)
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG nova.objects.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<5cc2418b-ae38-4884-a3e1-d0311f577d75> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "d86fc8487adab838be3f1e99af85305db917050b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "d86fc8487adab838be3f1e99af85305db917050b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:47 user nova-compute[75206]: WARNING nova.compute.manager [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state rescuing.
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing instance network info cache due to event network-changed-ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Acquiring lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Acquired lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Refreshing network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e9c0b062-adb7-4fc1-9998-19eda7c00490 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.virt.images [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] 18a33149-5e7d-4248-8771-b274f9438005 was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.part /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.part /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.converted" returned: 0 in 0.432s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updated VIF entry in instance network info cache for port ec0d31a2-a6f7-4d7f-b998-96b5730c9150. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-07a56d12-ef3c-4687-b71b-4a21696822c4 req-c6dff530-6f0e-4446-9714-1e31e023ce6f service nova] Releasing lock "refresh_cache-5cc2418b-ae38-4884-a3e1-d0311f577d75" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "d86fc8487adab838be3f1e99af85305db917050b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.167s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "d86fc8487adab838be3f1e99af85305db917050b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "d86fc8487adab838be3f1e99af85305db917050b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b,backing_fmt=raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b,backing_fmt=raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk 1073741824" returned: 0 in 0.060s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "d86fc8487adab838be3f1e99af85305db917050b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'migration_context' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG nova.objects.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<5cc2418b-ae38-4884-a3e1-d0311f577d75> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Rebasing disk image.
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:48 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 -F raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 -F raw /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk" returned: 0 in 1.942s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Ensure instance console log exists: /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start _get_guest_xml network_info=[{"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='da9baf555dc1bb7608e563b8225c761e',container_format='bare',created_at=2023-11-29T22:01:43Z,direct_url=<?>,disk_format='qcow2',id=18a33149-5e7d-4248-8771-b274f9438005,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1574489291-shelved',owner='0fefc9dd69d944df892990a9db00c4e8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T22:01:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '25a7e572-838f-4fd8-98d9-c18dbd9744fd', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMDQBzkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5cc2418b-ae38-4884-a3e1-d0311f577d75', 'attached_at': '', 'detached_at': '', 'volume_id': 'a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 'serial': 'a22f728f-4e0a-4c01-ac2c-375c0927a2c2'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:03:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='da9baf555dc1bb7608e563b8225c761e',container_format='bare',created_at=2023-11-29T22:01:43Z,direct_url=<?>,disk_format='qcow2',id=18a33149-5e7d-4248-8771-b274f9438005,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1574489291-shelved',owner='0fefc9dd69d944df892990a9db00c4e8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T22:01:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:50 user nova-compute[75206]: DEBUG nova.objects.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<5cc2418b-ae38-4884-a3e1-d0311f577d75> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMDQBzkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:03:51 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:03:51 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:03:51 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a38d4-66ed-44eb-aabb-0d87f359caae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:03:51 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fb0f88-b717-40f6-a471-9d657754a162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2] added
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34aab49-4441-4314-8299-5d4a4dee5994]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b599801-e68f-4769-bbb1-eb8327873d5e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMDQBzkF {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMDQBzkF" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1afc1-660d-4c73-8b8f-cc82677fd4f5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMDQBzkF'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb52b6bf-1550-494a-8664-aceec7ed4b56]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ea7b0-0e96-462c-80c4-393054f7636a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba400848-442d-4656-b55a-8fd7909d1a7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260]
Nov 29 22:03:51 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260] successful.
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250ca9f-94fa-4cc5-b557-8e28944d9a0e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eba615-0ce8-4c32-93b6-38de2d3ed16b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:03:51 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:03:51 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28967b5b-101b-4398-af48-d3b12d2a1650]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:51 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMDQBzkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26335653665303931', 'path': '/dev/sdh'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335653665303931', 'path': '/dev/sdh'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='18a33149-5e7d-4248-8771-b274f9438005',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1481084862',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:01:48.148198',shelved_host='user',shelved_image_id='18a33149-5e7d-4248-8771-b274f9438005'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.objects.base [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<5cc2418b-ae38-4884-a3e1-d0311f577d75> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:03:52 user nova-compute[75206]:   <uuid>5cc2418b-ae38-4884-a3e1-d0311f577d75</uuid>
Nov 29 22:03:52 user nova-compute[75206]:   <name>instance-00000023</name>
Nov 29 22:03:52 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:03:52 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:03:52 user nova-compute[75206]:   <metadata>
Nov 29 22:03:52 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:03:52 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1574489291</nova:name>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:03:50</nova:creationTime>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:03:52 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:03:52 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:owner>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:user uuid="e7d06116d600497090ba07fcb86ee782">tempest-AttachVolumeShelveTestJSON-700434495-project-member</nova:user>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:project uuid="0fefc9dd69d944df892990a9db00c4e8">tempest-AttachVolumeShelveTestJSON-700434495</nova:project>
Nov 29 22:03:52 user nova-compute[75206]:       </nova:owner>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:root type="image" uuid="18a33149-5e7d-4248-8771-b274f9438005"/>
Nov 29 22:03:52 user nova-compute[75206]:       <nova:ports>
Nov 29 22:03:52 user nova-compute[75206]:         <nova:port uuid="ec0d31a2-a6f7-4d7f-b998-96b5730c9150">
Nov 29 22:03:52 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 22:03:52 user nova-compute[75206]:         </nova:port>
Nov 29 22:03:52 user nova-compute[75206]:       </nova:ports>
Nov 29 22:03:52 user nova-compute[75206]:     </nova:instance>
Nov 29 22:03:52 user nova-compute[75206]:   </metadata>
Nov 29 22:03:52 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:03:52 user nova-compute[75206]:     <system>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="serial">5cc2418b-ae38-4884-a3e1-d0311f577d75</entry>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="uuid">5cc2418b-ae38-4884-a3e1-d0311f577d75</entry>
Nov 29 22:03:52 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:03:52 user nova-compute[75206]:     </system>
Nov 29 22:03:52 user nova-compute[75206]:   </sysinfo>
Nov 29 22:03:52 user nova-compute[75206]:   <os>
Nov 29 22:03:52 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:03:52 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:03:52 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:03:52 user nova-compute[75206]:   </os>
Nov 29 22:03:52 user nova-compute[75206]:   <features>
Nov 29 22:03:52 user nova-compute[75206]:     <acpi/>
Nov 29 22:03:52 user nova-compute[75206]:     <apic/>
Nov 29 22:03:52 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:03:52 user nova-compute[75206]:   </features>
Nov 29 22:03:52 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:03:52 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:03:52 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:03:52 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:03:52 user nova-compute[75206]:   </clock>
Nov 29 22:03:52 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:03:52 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:03:52 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:03:52 user nova-compute[75206]:   </cpu>
Nov 29 22:03:52 user nova-compute[75206]:   <devices>
Nov 29 22:03:52 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:03:52 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:03:52 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk"/>
Nov 29 22:03:52 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:03:52 user nova-compute[75206]:     </disk>
Nov 29 22:03:52 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:03:52 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:03:52 user nova-compute[75206]:       <source dev="/dev/sdh"/>
Nov 29 22:03:52 user nova-compute[75206]:       <target dev="vdc" bus="virtio"/>
Nov 29 22:03:52 user nova-compute[75206]:       <serial>a22f728f-4e0a-4c01-ac2c-375c0927a2c2</serial>
Nov 29 22:03:52 user nova-compute[75206]:     </disk>
Nov 29 22:03:52 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:03:52 user nova-compute[75206]:       <mac address="fa:16:3e:a7:ec:c1"/>
Nov 29 22:03:52 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:03:52 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:03:52 user nova-compute[75206]:       <target dev="tapec0d31a2-a6"/>
Nov 29 22:03:52 user nova-compute[75206]:     </interface>
Nov 29 22:03:52 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:03:52 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/console.log" append="off"/>
Nov 29 22:03:52 user nova-compute[75206]:     </serial>
Nov 29 22:03:52 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:03:52 user nova-compute[75206]:     <video>
Nov 29 22:03:52 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:03:52 user nova-compute[75206]:     </video>
Nov 29 22:03:52 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:03:52 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:03:52 user nova-compute[75206]:     </rng>
Nov 29 22:03:52 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:03:52 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:03:52 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:03:52 user nova-compute[75206]:     </memballoon>
Nov 29 22:03:52 user nova-compute[75206]:   </devices>
Nov 29 22:03:52 user nova-compute[75206]: </domain>
Nov 29 22:03:52 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='18a33149-5e7d-4248-8771-b274f9438005',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1481084862',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:01:48.148198',shelved_host='user',shelved_image_id='18a33149-5e7d-4248-8771-b274f9438005'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG os_vif [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2622738-4505-5283-bc84-480ee2f9b569', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec0d31a2-a6, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec0d31a2-a6, col_values=(('qos', UUID('407b703c-a016-494c-a1e3-3dd3028bc3e8')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec0d31a2-a6, col_values=(('external_ids', {'iface-id': 'ec0d31a2-a6f7-4d7f-b998-96b5730c9150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ec:c1', 'vm-uuid': '5cc2418b-ae38-4884-a3e1-d0311f577d75'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:52 user nova-compute[75206]: INFO os_vif [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6')
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:03:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No VIF found with MAC fa:16:3e:a7:ec:c1, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-changed-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Refreshing instance network info cache due to event network-changed-483f2cab-108a-4dd9-b2b7-ab9a188e0899. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] Acquiring lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] Acquired lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Refreshing network info cache for port 483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updated VIF entry in instance network info cache for port 483f2cab-108a-4dd9-b2b7-ab9a188e0899. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating instance_info_cache with network_info: [{"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e1d90e1-4525-453b-9485-5d49d597b839 req-eabc8ba3-23f2-4db9-ac9b-9addf64e85f4 service nova] Releasing lock "refresh_cache-e1e67b78-6589-4d67-b70f-96907954cb00" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:54 user nova-compute[75206]: WARNING nova.compute.manager [req-74388b79-27d5-43af-b0c8-74803a31f39f req-d1c225cb-4c8e-474d-acf5-a2801e8a78d4 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:55 user nova-compute[75206]: INFO nova.compute.manager [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attaching volume f28b0e86-b102-42a1-a2c6-1d66685334ab to /dev/vdb
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff70acb4-b00f-4150-b31e-7bb598c70077]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a427dba3-3d07-43c2-9e0e-1bd324a80d03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b84b0b-fecf-4626-b481-fc91ba60714d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[20236ff4-0748-47bb-88c1-3af8dda68593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:03:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:03:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9b530-3234-4756-8726-f5b2c554038b]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:03:55 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating existing volume attachment record: b40062f2-e695-4a6b-9450-69c2bb628f34 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing instance network info cache due to event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:03:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance spawned successfully.
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:56 user nova-compute[75206]: WARNING nova.compute.manager [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing instance network info cache due to event network-changed-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Acquiring lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:56 user nova-compute[75206]: INFO nova.compute.manager [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Detaching volume 1f1e6f71-c71f-48d1-84c1-ba74e8555fde
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:03:56 user nova-compute[75206]: INFO nova.virt.block_device [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Attempting to driver detach volume 1f1e6f71-c71f-48d1-84c1-ba74e8555fde from mountpoint /dev/vdb
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Attempting to detach device vdb from instance 0c62b909-1f4f-4fec-a4c1-c330379083de from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:03:56 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:03:56 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:03:56 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:03:56 user nova-compute[75206]:   <serial>1f1e6f71-c71f-48d1-84c1-ba74e8555fde</serial>
Nov 29 22:03:56 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:03:56 user nova-compute[75206]: </disk>
Nov 29 22:03:56 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:03:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully detached device vdb from instance 0c62b909-1f4f-4fec-a4c1-c330379083de from the persistent domain config.
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c62b909-1f4f-4fec-a4c1-c330379083de from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:03:56 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:03:56 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:03:56 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:03:56 user nova-compute[75206]:   <serial>1f1e6f71-c71f-48d1-84c1-ba74e8555fde</serial>
Nov 29 22:03:56 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:03:56 user nova-compute[75206]: </disk>
Nov 29 22:03:56 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7f657abc-aecf-466f-9a43-113f4ac497b9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.394s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updated VIF entry in instance network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-576051c5-bab9-4a0e-9f0a-2b1840097546 req-45f09f68-56f8-4dd8-bc07-4a43841959f1 service nova] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Acquired lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Refreshing network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing instance network info cache due to event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updated VIF entry in instance network info cache for port fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [{"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-51f5596e-8f01-4af4-ac51-713f94f732eb req-7787936a-6ae5-4e20-8337-7b9e2d8c2d2a service nova] Releasing lock "refresh_cache-0c62b909-1f4f-4fec-a4c1-c330379083de" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updated VIF entry in instance network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:57 user nova-compute[75206]: INFO nova.compute.manager [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Shelve offloading
Nov 29 22:03:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b83207c-dbe1-4348-b749-4a7e4d75afa3 req-8e4e428e-857e-40f5-948e-3b230f049ad4 service nova] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:03:58 user nova-compute[75206]: WARNING nova.compute.manager [req-d7360a3d-4851-4e16-9d3f-35e7c2326d3c req-474c8e89-5049-4476-8854-b65fb4bf3f86 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state shelving.
Nov 29 22:03:58 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance destroyed successfully.
Nov 29 22:03:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:03:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance destroyed successfully.
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'resources' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGF540cV/0ZM0hiFndiPUc2lnIxULHMgn2agKvc9uCojVqUaqEf4eDF+KtkQiDQSxpQSL5bygWcXo3Qg3L7tHi4pPv6GLyOxXgBEJ+4JxEeIeEsqRYygb1s1SHpDa4IJ3g==',key_name='tempest-TestShelveInstance-381264103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:02:22Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_vif [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing instance network info cache due to event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.network.neutron [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a20a21-ef, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2e4d563-7748-423a-a29d-c7833dd0644f) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:03:59 user nova-compute[75206]: INFO os_vif [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef')
Nov 29 22:03:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:03:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818ea28-0978-4c81-b028-9d3c3b08efb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:03:59 user nova-compute[75206]: No targets found.
Nov 29 22:03:59 user nova-compute[75206]: iSNS:
Nov 29 22:03:59 user nova-compute[75206]: No targets found.
Nov 29 22:03:59 user nova-compute[75206]: STATIC:
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:03:59 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:03:59 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:03:59 user nova-compute[75206]: FIRMWARE:
Nov 29 22:03:59 user nova-compute[75206]: No targets found.
Nov 29 22:03:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:03:59 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:03:59 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:03:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532b307-9683-422b-919b-24acf6b7eb76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f786814-3cdf-4605-b0c0-a921b747283b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:00 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:00 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:00 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c807c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd'): ({'sdg'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Removing single pathed devices sdg {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da5fcc-4165-4446-9c29-298e2b16c2fa]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851c00d-8a58-4147-a582-bd56cd1a524e]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flushing IO for device /dev/sdg {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1f4b89-ee08-4fd6-b48f-f8fb6f6ccb26]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e569227b-de60-4a29-8d55-4448550d6832]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c1733-f869-42f1-853b-71b94c6c453e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[686599f8-1644-41b2-9c50-a4921b740b0b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]
Nov 29 22:04:00 user nova-compute[75206]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.
Nov 29 22:04:00 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:04:00 user nova-compute[75206]: WARNING nova.compute.manager [req-e3e6baba-b31a-4792-add3-b13b24fd88a6 req-5fe62024-8384-4903-8d34-9e361e85733d service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state shelving.
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d87226-031c-47b7-99e8-4c8f7ff89d9b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== disconnect_volume: return (389ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:04:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deleting instance files /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4_del
Nov 29 22:04:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deletion of /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4_del complete
Nov 29 22:04:00 user nova-compute[75206]: DEBUG nova.network.neutron [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updated VIF entry in instance network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG nova.network.neutron [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": null, "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75a20a21-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-84b403f5-4f20-4c8e-acb7-1afb08ae451d req-a7b149da-7916-4b2b-b02b-81938ab4a6e5 service nova] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-changed-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Refreshing instance network info cache due to event network-changed-e523b35a-eccb-48c0-82b9-f6206000d47e. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] Acquiring lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] Acquired lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Refreshing network info cache for port e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'flavor' on Instance uuid 742b3d8a-d614-4c14-a04d-f000e97b4af4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Ignoring supplied device name: /dev/vdb
Nov 29 22:04:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:03 user nova-compute[75206]: INFO nova.compute.manager [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Attaching volume 04c67407-0319-45c6-8591-180a64981483 to /dev/vdb
Nov 29 22:04:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updated VIF entry in instance network info cache for port e523b35a-eccb-48c0-82b9-f6206000d47e. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updating instance_info_cache with network_info: [{"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8fa7d64c-17a3-4c4c-9e29-1c7d8aff00d1 req-aedcb5e1-eeb4-4b8b-b696-5ea85398d405 service nova] Releasing lock "refresh_cache-742b3d8a-d614-4c14-a04d-f000e97b4af4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68be15-8613-4f5b-868e-ab5668fff8a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e252d516-f946-4aad-b955-3132fce45e49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[368ddd97-ef35-45e5-8e4c-0374c7c94678]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed5bd7-0f86-4c6c-8964-86cd1f640627]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:04:03 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:04:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977a5f9-1e5e-4d4a-b667-5652786fdf6c]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:03 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updating existing volume attachment record: 17112a90-e16f-41a8-a12b-f9daf4215a60 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:04:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.volume.cinder [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Update attachment failed for attachment 17112a90-e16f-41a8-a12b-f9daf4215a60. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Failed to attach 04c67407-0319-45c6-8591-180a64981483 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Traceback (most recent call last):
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     self._do_attach(context, instance, volume, volume_api,
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     self._volume_attach(context, volume, connector, instance,
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     connection_info = volume_api.attachment_update(
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     res = method(self, ctx, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     return method.func(obj, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     resp = self._update('/attachments/%s' % id, body)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     return self.request(url, method, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4]     raise exceptions.from_response(resp, body)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42)
Nov 29 22:04:05 user nova-compute[75206]: ERROR nova.compute.manager [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] 
Nov 29 22:04:05 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Deleted allocations for instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 2.632s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtPhyvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:05 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a342348c-085b-40d2-9381-a60f7d78386c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'numa_topology' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:04:05 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG nova.objects.base [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Object Instance<69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4> lazy-loaded attributes: resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[953eb11e-ad12-43d3-bc6b-11ebbc56e609]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab] added
Nov 29 22:04:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server [None req-8074a868-e00e-4fb1-8a46-c832220b2cc4 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1baaf2d7-5a30-45a0-b829-e7890dac3f42)
Nov 29 22:04:05 user nova-compute[75206]: ERROR oslo_messaging.rpc.server 
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[555bf55a-d238-43fa-9701-537b22dfd2bf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ebc59-e3ed-4e59-ab62-66804a974ac6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtPhyvGa {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtPhyvGa" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56575d6-cc6f-4545-936f-ce722d018fb9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QtPhyvGa'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b4a137-86b0-4131-9847-c0f1844c6000]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ef270-d05f-4420-9434-a69429271b1d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:05 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a68e60-f7b6-45dd-a1dd-a79e0ea83fc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260]
Nov 29 22:04:06 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260] successful.
Nov 29 22:04:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec96ab-c407-4613-a204-e64e1f940592]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d08646-ba30-4b95-b7a4-2d80be22c87c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:06 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee88e3a-e3d5-4538-acf1-5ac5ba9cff08]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtPhyvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cad2f9cf-2a6a-4427-b23d-75ce7cf9d1a2 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.668s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23966353936316630', 'path': '/dev/sdg'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966353936316630', 'path': '/dev/sdg'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:04:07 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:04:07 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 22:04:07 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:04:07 user nova-compute[75206]:   <serial>f28b0e86-b102-42a1-a2c6-1d66685334ab</serial>
Nov 29 22:04:07 user nova-compute[75206]: </disk>
Nov 29 22:04:07 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No VIF found with MAC fa:16:3e:e3:e5:44, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:04:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9665eff8-c690-46fa-8c6c-89d71efd1844 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.989s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:10 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:11 user nova-compute[75206]: INFO nova.compute.manager [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attaching volume 1f62105f-bcba-4a9e-9fbf-6946788e6896 to /dev/vdc
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.utils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa776b67-7248-4b3f-ade4-f3c07b404785]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443f21a-40c7-4376-a938-0e692167ca7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b8571-238d-4709-9069-94114c0683e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ceaca-0815-4415-83dd-0af08bceedc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:04:11 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:04:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2246a31e-e54b-4bfa-bfd0-cc9be05833ea]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG os_brick.utils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:11 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating existing volume attachment record: 385bcad8-d902-4d87-b46a-0e10246b4690 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:04:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Going to confirm migration 2 {{(pid=75206) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquired lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'info_cache' on Instance uuid 47df4638-2c13-4c33-8b8d-f7a5d5d3338f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG nova.network.neutron [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [{"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Releasing lock "refresh_cache-47df4638-2c13-4c33-8b8d-f7a5d5d3338f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'migration_context' on Instance uuid 47df4638-2c13-4c33-8b8d-f7a5d5d3338f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG nova.objects.base [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Object Instance<47df4638-2c13-4c33-8b8d-f7a5d5d3338f> lazy-loaded attributes: info_cache,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:04:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.436s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:16 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Deleted allocation for migration 2c5652c6-bec0-44e8-9284-c74107be8c3e
Nov 29 22:04:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bec640ea-31dd-4b2f-b53b-ae6bc9cadadb tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.532s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:17 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c62b909-1f4f-4fec-a4c1-c330379083de is timed out.
Nov 29 22:04:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully detached device vdb from instance 0c62b909-1f4f-4fec-a4c1-c330379083de from the live domain config.
Nov 29 22:04:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZowrYRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:17 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a3729-9ba4-4984-961c-5833c8e19137]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:04:17 user nova-compute[75206]: No targets found.
Nov 29 22:04:17 user nova-compute[75206]: iSNS:
Nov 29 22:04:17 user nova-compute[75206]: No targets found.
Nov 29 22:04:17 user nova-compute[75206]: STATIC:
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:04:17 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:17 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:17 user nova-compute[75206]: FIRMWARE:
Nov 29 22:04:17 user nova-compute[75206]: No targets found.
Nov 29 22:04:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:04:17 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:04:17 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0f3a4-2cf0-4376-adbb-e986801d58c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9f61c-13c8-4bd8-b765-3cbf42a4e947]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:17 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8201c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7e2d2-1668-4947-a7be-ce0dc6c44dcc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fdca74-2b65-4f32-8488-09a876e9e43f]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f8989-b3cd-4cba-ba42-15804f675b87]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e054d-fd99-4b04-b96e-0c681c13dbb3]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b742d6b-d455-4253-8a2f-2d28754020c1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d11011f-28f2-4652-814d-f832edae81f6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260]
Nov 29 22:04:17 user nova-compute[75206]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde, portal: 172.16.0.220,3260] successful.
Nov 29 22:04:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e6f71-c71f-48d1-84c1-ba74e8555fde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05b480-60e5-4dd5-854c-ed99d20e88ce]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] <== disconnect_volume: return (322ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:04:18 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'flavor' on Instance uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c43db75f-b3f1-426c-8caf-022dbded1f05 tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLasINgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:19 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:19 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:19 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e113733b-80c2-4ce6-8a83-2871daec389f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:04:19 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9746622-b21c-4fbd-951a-ca9ceee8d6ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896] added
Nov 29 22:04:19 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd75d2-b6b1-4b3f-9e46-1876c27ded5f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a9a50-805a-40eb-a796-2bb3e85f7c32]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLasINgO {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLasINgO" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2bf389-731b-4c13-8b33-518f4b5e1279]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLasINgO'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:19 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8ffe60-3ed1-43ea-8e78-95283780a30d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3302f3-2210-4fcb-baae-04bc3347a72e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfaf940-a144-4cac-b632-e79fc7ed6240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260]
Nov 29 22:04:20 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260] successful.
Nov 29 22:04:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee184a3-a0b1-4e44-9f14-33351317c00d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66393a5-f68b-48f2-9a46-09458cd561e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:20 user nova-compute[75206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)
Nov 29 22:04:20 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be89221-9f52-4478-8804-a7b04845e793]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:20 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLasINgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23964346539646231', 'path': '/dev/sde'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964346539646231', 'path': '/dev/sde'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:04:21 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:04:21 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:04:21 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:04:21 user nova-compute[75206]:   <serial>1f62105f-bcba-4a9e-9fbf-6946788e6896</serial>
Nov 29 22:04:21 user nova-compute[75206]: </disk>
Nov 29 22:04:21 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] No VIF found with MAC fa:16:3e:e3:e5:44, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:04:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2480aac9-8886-456c-b85f-adb13a3849c2 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.630s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:22 user nova-compute[75206]: INFO nova.compute.manager [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Detaching volume 1f62105f-bcba-4a9e-9fbf-6946788e6896
Nov 29 22:04:22 user nova-compute[75206]: INFO nova.virt.block_device [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attempting to driver detach volume 1f62105f-bcba-4a9e-9fbf-6946788e6896 from mountpoint /dev/vdc
Nov 29 22:04:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Attempting to detach device vdc from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:04:22 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:04:22 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:04:22 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:04:22 user nova-compute[75206]:   <serial>1f62105f-bcba-4a9e-9fbf-6946788e6896</serial>
Nov 29 22:04:22 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 22:04:22 user nova-compute[75206]: </disk>
Nov 29 22:04:22 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:04:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully detached device vdc from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the persistent domain config.
Nov 29 22:04:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:04:22 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:04:22 user nova-compute[75206]:   <source dev="/dev/sde"/>
Nov 29 22:04:22 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:04:22 user nova-compute[75206]:   <serial>1f62105f-bcba-4a9e-9fbf-6946788e6896</serial>
Nov 29 22:04:22 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 22:04:22 user nova-compute[75206]: </disk>
Nov 29 22:04:22 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:04:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:04:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:04:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7203MB free_disk=24.634464263916016GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 0c62b909-1f4f-4fec-a4c1-c330379083de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 648e90b8-b0c6-4a64-ae14-d019848019d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e1e67b78-6589-4d67-b70f-96907954cb00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 742b3d8a-d614-4c14-a04d-f000e97b4af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:04:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:04:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [{"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-d3083fb2-1acb-4cef-9ca0-061c1b1ab540" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:04:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e1e67b78-6589-4d67-b70f-96907954cb00 is timed out.
Nov 29 22:04:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully detached device vdc from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the live domain config.
Nov 29 22:04:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLasINgO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:04:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55e80bd-1a9d-448d-91db-3eb7ee85908e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:04:42 user nova-compute[75206]: No targets found.
Nov 29 22:04:42 user nova-compute[75206]: iSNS:
Nov 29 22:04:42 user nova-compute[75206]: No targets found.
Nov 29 22:04:42 user nova-compute[75206]: STATIC:
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:04:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:04:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:04:42 user nova-compute[75206]: FIRMWARE:
Nov 29 22:04:42 user nova-compute[75206]: No targets found.
Nov 29 22:04:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:04:42 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:04:42 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13e5d8-dea0-4d7e-a80c-3c1b7f8bd46e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9eaa1e-faad-47f0-a4b3-000ad31670ce]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:04:42 user nova-compute[75206]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 (non-flash)
Nov 29 22:04:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d2eb2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896'): ({'sde'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Removing single pathed devices sde {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71283ea-ebf3-4487-9879-3b4afe46c51b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd3802f-909e-45d4-b00b-aa32722d8310]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Flushing IO for device /dev/sde {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf58a08-5094-4f45-8790-6fd499f47dc4]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[913bada8-0249-4170-a398-ed8da98faeb3]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] SCSI volumes sde have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b07f3-2447-45aa-a9f6-fed0831d138e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a4393-5cba-49f3-bfde-6a08fcbc91e2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260]
Nov 29 22:04:42 user nova-compute[75206]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896, portal: 172.16.0.220,3260] successful.
Nov 29 22:04:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f62105f-bcba-4a9e-9fbf-6946788e6896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e9e23-39b0-4697-bfcf-b31d18f9aeae]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== disconnect_volume: return (311ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:04:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:04:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:04:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-14dc6102-ea90-48de-9f04-06424cbb84b0 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:04:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:51 user nova-compute[75206]: INFO nova.compute.manager [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Terminating instance
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-5b6d1109-2d90-49c5-a605-4fb20f969dd2 req-bdf06371-ffb5-4c1c-9b31-be1bbb951e46 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-unplugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Instance destroyed successfully.
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.objects.instance [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lazy-loading 'resources' on Instance uuid 0c62b909-1f4f-4fec-a4c1-c330379083de {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-999232757',display_name='tempest-TestMinimumBasicScenario-server-999232757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-999232757',id=34,image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuM24W/72UOg7BGLjw5WeFX6apW7aanvQ6vgDCTWQjzoaZnsIToTfrIY6S4TeucEPaBAysvgA2OnAIv8/lIHW1J9GHlbqzAXrSGX72soCxBrfr8sohBFRoqtz07aWI5oA==',key_name='tempest-TestMinimumBasicScenario-2140076803',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84edc3e740a04e4eb7cdec55bbc1f4c9',ramdisk_id='',reservation_id='r-xnebfw4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01f91b95-500c-4a2a-9940-eef1b06910b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2060893910',owner_user_name='tempest-TestMinimumBasicScenario-2060893910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:02:12Z,user_data=None,user_id='e456426697854165bbdd8d8f4a39cd77',uuid=0c62b909-1f4f-4fec-a4c1-c330379083de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:04:51 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converting VIF {"id": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "address": "fa:16:3e:49:84:86", "network": {"id": "25a623af-1021-44c3-94b2-4819781c8058", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1785471987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84edc3e740a04e4eb7cdec55bbc1f4c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbaf3d5d-f4", "ovs_interfaceid": "fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG os_vif [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbaf3d5d-f4, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=555cbb1a-d1be-433b-8aeb-14e068e382df) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: INFO os_vif [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:84:86,bridge_name='br-int',has_traffic_filtering=True,id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b,network=Network(25a623af-1021-44c3-94b2-4819781c8058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbaf3d5d-f4')
Nov 29 22:04:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Deleting instance files /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de_del
Nov 29 22:04:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Deletion of /opt/stack/data/nova/instances/0c62b909-1f4f-4fec-a4c1-c330379083de_del complete
Nov 29 22:04:52 user nova-compute[75206]: INFO nova.compute.manager [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 22:04:52 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:52 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Took 0.50 seconds to deallocate network for instance.
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-36c05389-0a80-4873-a85f-6dfbc0051a3a req-8acb8895-9765-4715-ac43-036b656dcb35 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-deleted-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:04:52 user nova-compute[75206]: INFO nova.compute.manager [req-36c05389-0a80-4873-a85f-6dfbc0051a3a req-8acb8895-9765-4715-ac43-036b656dcb35 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Neutron deleted interface fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b; detaching it from the instance and deleting it from the info cache
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.network.neutron [req-36c05389-0a80-4873-a85f-6dfbc0051a3a req-8acb8895-9765-4715-ac43-036b656dcb35 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-36c05389-0a80-4873-a85f-6dfbc0051a3a req-8acb8895-9765-4715-ac43-036b656dcb35 service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Detach interface failed, port_id=fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b, reason: Instance 0c62b909-1f4f-4fec-a4c1-c330379083de could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:04:52 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:53 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Deleted allocations for instance 0c62b909-1f4f-4fec-a4c1-c330379083de
Nov 29 22:04:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-42f30888-73cc-4f2c-82e5-efb89552b25a tempest-TestMinimumBasicScenario-2060893910 tempest-TestMinimumBasicScenario-2060893910-project-member] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] Acquiring lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] Lock "0c62b909-1f4f-4fec-a4c1-c330379083de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:04:53 user nova-compute[75206]: DEBUG nova.compute.manager [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] No waiting events found dispatching network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:04:53 user nova-compute[75206]: WARNING nova.compute.manager [req-18b7494f-bb6a-4959-85d2-4a41a3b11de2 req-8d889f2a-1fe2-4827-94b4-776fcd673f8e service nova] [instance: 0c62b909-1f4f-4fec-a4c1-c330379083de] Received unexpected event network-vif-plugged-fbaf3d5d-f4e2-430f-9ad3-2ae5c56af54b for instance with vm_state deleted and task_state None.
Nov 29 22:04:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing instance network info cache due to event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:05:07 user nova-compute[75206]: DEBUG nova.network.neutron [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updated VIF entry in instance network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95efafdd-5958-4b0d-b4c7-8a5fbb2cf2bb req-218c4067-3c18-4b18-b835-21be2892c9f0 service nova] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:05:08 user nova-compute[75206]: INFO nova.compute.manager [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Detaching volume a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:05:08 user nova-compute[75206]: INFO nova.virt.block_device [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Attempting to driver detach volume a1fb7adb-d318-43b4-a301-eb402edd49ac from mountpoint /dev/vdb
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Attempting to detach device vdb from instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:08 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:08 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 22:05:08 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:05:08 user nova-compute[75206]:   <serial>a1fb7adb-d318-43b4-a301-eb402edd49ac</serial>
Nov 29 22:05:08 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:05:08 user nova-compute[75206]: </disk>
Nov 29 22:05:08 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully detached device vdb from instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 from the persistent domain config.
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:08 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:08 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 22:05:08 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:05:08 user nova-compute[75206]:   <serial>a1fb7adb-d318-43b4-a301-eb402edd49ac</serial>
Nov 29 22:05:08 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:05:08 user nova-compute[75206]: </disk>
Nov 29 22:05:08 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:05:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing instance network info cache due to event network-changed-5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:05:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] Acquiring lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:05:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] Acquired lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:05:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Refreshing network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:05:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updated VIF entry in instance network info cache for port 5b614235-5a18-4441-bac0-0c3573f0c014. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:05:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [{"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:05:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19455cfb-b24a-49d2-9d25-c1632f20b7f6 req-fa18e45f-06d8-415a-aeb8-c30a6d8b7940 service nova] Releasing lock "refresh_cache-21ba84fd-5988-4a9c-8b2b-b710981d5be5" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:12 user nova-compute[75206]: INFO nova.compute.manager [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Detaching volume f28b0e86-b102-42a1-a2c6-1d66685334ab
Nov 29 22:05:12 user nova-compute[75206]: INFO nova.virt.block_device [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Attempting to driver detach volume f28b0e86-b102-42a1-a2c6-1d66685334ab from mountpoint /dev/vdb
Nov 29 22:05:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Attempting to detach device vdb from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:12 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:12 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 22:05:12 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:05:12 user nova-compute[75206]:   <serial>f28b0e86-b102-42a1-a2c6-1d66685334ab</serial>
Nov 29 22:05:12 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:05:12 user nova-compute[75206]: </disk>
Nov 29 22:05:12 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:12 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully detached device vdb from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the persistent domain config.
Nov 29 22:05:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:05:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:12 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:12 user nova-compute[75206]:   <source dev="/dev/sdg"/>
Nov 29 22:05:12 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:05:12 user nova-compute[75206]:   <serial>f28b0e86-b102-42a1-a2c6-1d66685334ab</serial>
Nov 29 22:05:12 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:05:12 user nova-compute[75206]: </disk>
Nov 29 22:05:12 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:05:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:25 user nova-compute[75206]: INFO nova.compute.manager [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Detaching volume a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:05:25 user nova-compute[75206]: INFO nova.virt.block_device [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Attempting to driver detach volume a22f728f-4e0a-4c01-ac2c-375c0927a2c2 from mountpoint /dev/vdc
Nov 29 22:05:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Attempting to detach device vdc from instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:05:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:25 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:25 user nova-compute[75206]:   <source dev="/dev/sdh"/>
Nov 29 22:05:25 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:05:25 user nova-compute[75206]:   <serial>a22f728f-4e0a-4c01-ac2c-375c0927a2c2</serial>
Nov 29 22:05:25 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 22:05:25 user nova-compute[75206]: </disk>
Nov 29 22:05:25 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:25 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully detached device vdc from instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 from the persistent domain config.
Nov 29 22:05:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:05:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:05:25 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:05:25 user nova-compute[75206]:   <source dev="/dev/sdh"/>
Nov 29 22:05:25 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:05:25 user nova-compute[75206]:   <serial>a22f728f-4e0a-4c01-ac2c-375c0927a2c2</serial>
Nov 29 22:05:25 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 22:05:25 user nova-compute[75206]: </disk>
Nov 29 22:05:25 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:05:26 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:05:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:28 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 is timed out.
Nov 29 22:05:28 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully detached device vdb from instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 from the live domain config.
Nov 29 22:05:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvPRVAzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:05:28 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6101c-0801-4497-a4f9-b7c45c11dd13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:05:28 user nova-compute[75206]: No targets found.
Nov 29 22:05:28 user nova-compute[75206]: iSNS:
Nov 29 22:05:28 user nova-compute[75206]: No targets found.
Nov 29 22:05:28 user nova-compute[75206]: STATIC:
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:05:28 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:28 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:28 user nova-compute[75206]: FIRMWARE:
Nov 29 22:05:28 user nova-compute[75206]: No targets found.
Nov 29 22:05:28 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:05:28 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:05:28 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[14804a6f-bd54-4b35-b479-73d8f6b4c9d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d161b8-ff7c-49bb-80b1-72897b22d32f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:05:28 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:28 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:05:28 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498625090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be342113-7cc7-4257-ba11-f466557ed8b1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b41b3a-0660-407e-a4fa-7d9579d36f9e]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f33263-ae29-4ffb-8411-9557674e564a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f953cc-4e2c-406a-a287-666a51217c32]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a988b-ffb5-49ec-90bf-72827284e484]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7660193-3e70-4f66-88ff-c42c13e8cc79]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260]
Nov 29 22:05:28 user nova-compute[75206]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac, portal: 172.16.0.220,3260] successful.
Nov 29 22:05:28 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1fb7adb-d318-43b4-a301-eb402edd49ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26221bd0-bb99-451c-bea2-8f962eb9e709]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] <== disconnect_volume: return (349ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:05:28 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG nova.objects.instance [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'flavor' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-80fd93f5-586e-4e29-9f89-2e1c04ea3505 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: INFO nova.compute.manager [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Unrescuing
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquired lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG nova.network.neutron [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG nova.network.neutron [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating instance_info_cache with network_info: [{"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Releasing lock "refresh_cache-648e90b8-b0c6-4a64-ae14-d019848019d9" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG nova.objects.instance [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'flavor' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG nova.compute.manager [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG nova.compute.manager [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:31 user nova-compute[75206]: WARNING nova.compute.manager [req-6ad6c835-3104-41fc-9051-d4c5104b27d4 req-766ac88d-834c-4027-82b9-3e9c3a2a46f5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance destroyed successfully.
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1e67b78-6589-4d67-b70f-96907954cb00 is timed out.
Nov 29 22:05:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully detached device vdb from instance e1e67b78-6589-4d67-b70f-96907954cb00 from the live domain config.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtPhyvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.compute.manager [req-368a5f3c-7393-4b23-afa7-f8b56ad82987 req-ed0f2da6-4e63-4099-9ebe-2a50bcb902d5 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state rescued and task_state unrescuing.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726b16d-8fb3-42cd-9128-e56b4839926c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:05:33 user nova-compute[75206]: No targets found.
Nov 29 22:05:33 user nova-compute[75206]: iSNS:
Nov 29 22:05:33 user nova-compute[75206]: No targets found.
Nov 29 22:05:33 user nova-compute[75206]: STATIC:
Nov 29 22:05:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:05:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:05:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:05:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab
Nov 29 22:05:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:33 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:05:33 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:33 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:33 user nova-compute[75206]: FIRMWARE:
Nov 29 22:05:33 user nova-compute[75206]: No targets found.
Nov 29 22:05:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:05:33 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:05:33 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc21df6-a7cd-4ff7-bd72-7896fee5f6a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b7daa-3c2d-4f9f-8d44-71e797d95fe2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:05:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:33 user nova-compute[75206]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab (non-flash)
Nov 29 22:05:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b840fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab'): ({'sdg'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Removing single pathed devices sdg {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070cf24-77fa-4256-bf8f-82f83ae193a5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f01aa5-763c-423f-8f34-08f37bea46f5]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Flushing IO for device /dev/sdg {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeeb479-a7f1-4807-813a-333824cc5dda]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72815de2-082b-4425-a571-3bd3e1bcb04b]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] SCSI volumes sdg have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac39d3c-bab2-44b7-b5a5-7a7518e15ea2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60dd91f-6c5f-4ce4-995e-485341dfb03f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260]
Nov 29 22:05:33 user nova-compute[75206]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab, portal: 172.16.0.220,3260] successful.
Nov 29 22:05:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f28b0e86-b102-42a1-a2c6-1d66685334ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25277186-dc82-4281-8a78-ad6b917d5308]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] <== disconnect_volume: return (368ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:05:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:05:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7470MB free_disk=24.660614013671875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 648e90b8-b0c6-4a64-ae14-d019848019d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e1e67b78-6589-4d67-b70f-96907954cb00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 742b3d8a-d614-4c14-a04d-f000e97b4af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'flavor' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-57a272a2-6918-4a82-a5e9-83a82ecb55d8 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:05:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG nova.compute.manager [None req-454884fd-90d6-48ec-958e-95d50e344f88 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:35 user nova-compute[75206]: WARNING nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state None.
Nov 29 22:05:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:35 user nova-compute[75206]: DEBUG nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:35 user nova-compute[75206]: WARNING nova.compute.manager [req-029955be-4fde-4762-9090-b73dd54bfe82 req-72359206-a7fc-4ffd-b9f9-0e800338c676 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state None.
Nov 29 22:05:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:05:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:05:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:05:36 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updating instance_info_cache with network_info: [{"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-f5314b05-629e-4844-9496-f8e23c5c2e01" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:05:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:05:46 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 is timed out.
Nov 29 22:05:46 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully detached device vdc from instance 5cc2418b-ae38-4884-a3e1-d0311f577d75 from the live domain config.
Nov 29 22:05:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMDQBzkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:05:46 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906fbb7-1d76-43e2-98e3-609b6ec7f4d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:05:46 user nova-compute[75206]: No targets found.
Nov 29 22:05:46 user nova-compute[75206]: iSNS:
Nov 29 22:05:46 user nova-compute[75206]: No targets found.
Nov 29 22:05:46 user nova-compute[75206]: STATIC:
Nov 29 22:05:46 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:05:46 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:46 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:46 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:05:46 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:46 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:46 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2
Nov 29 22:05:46 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:46 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:46 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:05:46 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:05:46 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:05:46 user nova-compute[75206]: FIRMWARE:
Nov 29 22:05:46 user nova-compute[75206]: No targets found.
Nov 29 22:05:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:05:46 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:05:46 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[33118bc9-a1a9-42ac-8561-aa95907d773b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd9222-3a83-42b2-af0f-ead8766dc14e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:05:46 user nova-compute[75206]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 (non-flash)
Nov 29 22:05:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498625360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2'): ({'sdh'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Removing single pathed devices sdh {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e25a92d-40b3-4f7b-9dbc-67c7f00bd41b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d792a1f7-5a75-4e73-b3cb-ce8a0ae026b8]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flushing IO for device /dev/sdh {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd1b3b-da4e-479f-a429-3b24bf49be10]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db537ff9-a2b1-427f-86b0-197adc8858d4]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] SCSI volumes sdh have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79dd30-ca8c-442b-9e51-d2999287cc52]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d4fd8f-617c-4891-a24d-569d2fa1ff1a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260]
Nov 29 22:05:46 user nova-compute[75206]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2, portal: 172.16.0.220,3260] successful.
Nov 29 22:05:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22f728f-4e0a-4c01-ac2c-375c0927a2c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53da76f-22e2-4e91-804f-a6e4193f55a0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] <== disconnect_volume: return (345ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:05:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'flavor' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30d461bf-0711-4bcf-8c78-4eec3fad6ac9 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:49 user nova-compute[75206]: INFO nova.compute.manager [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Unshelving
Nov 29 22:05:49 user nova-compute[75206]: INFO nova.virt.block_device [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Booting with volume bffbb024-2bd9-4728-b6fc-d3ca3c2624fd at /dev/vda
Nov 29 22:05:49 user nova-compute[75206]: DEBUG os_brick.utils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681f530-eca7-43b7-a943-a489a8540e9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4b6e7-457e-466b-8555-8b50f0079ed7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d01ef-4983-46fd-aec0-a9cb0abe43d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3046272-2c66-4af8-8ecc-1b5600889776]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:05:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:05:50 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:05:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7952d360-1997-403c-a022-50c68c0a125a]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:05:50 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating existing volume attachment record: da9dafb1-3a5c-4c11-842e-7f376050af94 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:05:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:05:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:58 user nova-compute[75206]: INFO nova.compute.manager [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Terminating instance
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'pci_requests' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'numa_topology' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:05:58 user nova-compute[75206]: INFO nova.compute.claims [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Claim successful on node user
Nov 29 22:05:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:05:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-3b261b7c-71f7-4792-a705-934fbb8163bf req-3e86183d-e4a5-4e06-9762-1c61ebf93a23 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-unplugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:05:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Instance destroyed successfully.
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 21ba84fd-5988-4a9c-8b2b-b710981d5be5 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-555833462',display_name='tempest-ServerRescueNegativeTestJSON-server-555833462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-555833462',id=33,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoboCZMxVTfgRk1v85pAzAHlE0D3c1Dnq8H8Pq9WEa4pe9EM9RAkjx74BBBscZynnADJM80ke9KGFTSgcS9/aiUHbEU/M16jv/uWrOJ9aAuGvRkuhzKx0IL3g53dhU2ZA==',key_name='tempest-keypair-39788666',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-hsyq27bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=21ba84fd-5988-4a9c-8b2b-b710981d5be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "5b614235-5a18-4441-bac0-0c3573f0c014", "address": "fa:16:3e:cd:99:8d", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b614235-5a", "ovs_interfaceid": "5b614235-5a18-4441-bac0-0c3573f0c014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG os_vif [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b614235-5a, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a62c7734-5233-4ef4-b05f-e5ddded4b0df) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:05:59 user nova-compute[75206]: INFO os_vif [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:99:8d,bridge_name='br-int',has_traffic_filtering=True,id=5b614235-5a18-4441-bac0-0c3573f0c014,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b614235-5a')
Nov 29 22:05:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Deleting instance files /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5_del
Nov 29 22:05:59 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Deletion of /opt/stack/data/nova/instances/21ba84fd-5988-4a9c-8b2b-b710981d5be5_del complete
Nov 29 22:05:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:05:59 user nova-compute[75206]: INFO nova.compute.manager [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 22:05:59 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:05:59 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:05:59 user nova-compute[75206]: INFO nova.network.neutron [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 22:06:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] Acquiring lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] No waiting events found dispatching network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:00 user nova-compute[75206]: WARNING nova.compute.manager [req-ed28bde6-44fa-4b91-be88-35e9866ba57e req-23baeee7-83ff-4e33-a30a-27933c9e7168 service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received unexpected event network-vif-plugged-5b614235-5a18-4441-bac0-0c3573f0c014 for instance with vm_state active and task_state deleting.
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:01 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Took 1.87 seconds to deallocate network for instance.
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-dbcb047e-a7f3-4638-adea-2093543728c4 req-38d12cf0-c0eb-4036-a4a5-a22b3deeeffd service nova] [instance: 21ba84fd-5988-4a9c-8b2b-b710981d5be5] Received event network-vif-deleted-5b614235-5a18-4441-bac0-0c3573f0c014 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.network.neutron [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:01 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Deleted allocations for instance 21ba84fd-5988-4a9c-8b2b-b710981d5be5
Nov 29 22:06:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3d376850-6f46-46e4-90f8-32c792bb34f9 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "21ba84fd-5988-4a9c-8b2b-b710981d5be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.487s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.network.neutron [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:06:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Creating image(s)
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Ensure instance console log exists: /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start _get_guest_xml network_info=[{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'da9dafb1-3a5c-4c11-842e-7f376050af94', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'serial': 'bffbb024-2bd9-4728-b6fc-d3ca3c2624fd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:06:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:01 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.objects.instance [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:06:01 user nova-compute[75206]: DEBUG nova.objects.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Object Instance<69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:06:02 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:06:02 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:06:02 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91daf4e0-5de3-408f-8231-1d485b22a767]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:06:02 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dac0d3-fd8e-4aee-8287-09d9ea84583d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd] added
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e73d0-1068-41ea-b1db-2b3bf45a646b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea44d0-3dbb-4515-8bdc-5b48b71ba34f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQIuEygh {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQIuEygh" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61fbd1-20af-4080-bcb0-e995bd2db53f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQIuEygh'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a80729-f261-42ec-8074-1a195924a55c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be6e8d8-ef48-4b5f-9de4-49cb1e87ec24]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871414b-cdb0-4e15-98f1-5ff2b7023a3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]
Nov 29 22:06:02 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4329d3-d417-4373-8838-4ed11368292b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c1f2e-8f82-4d64-b45f-6ce9e76bb4bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:06:02 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:06:02 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf6541-9b79-4abb-8145-ce9249be73bf]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:02 user nova-compute[75206]: INFO nova.compute.manager [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Terminating instance
Nov 29 22:06:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23337303735663334', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303735663334', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-381264103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:05:50Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.objects.instance [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'pci_devices' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.objects.base [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Object Instance<69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:06:03 user nova-compute[75206]:   <uuid>69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</uuid>
Nov 29 22:06:03 user nova-compute[75206]:   <name>instance-00000027</name>
Nov 29 22:06:03 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:06:03 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:06:03 user nova-compute[75206]:   <metadata>
Nov 29 22:06:03 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:06:03 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:06:03 user nova-compute[75206]:       <nova:name>tempest-TestShelveInstance-server-1900707054</nova:name>
Nov 29 22:06:03 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:06:01</nova:creationTime>
Nov 29 22:06:03 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:06:03 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:06:03 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:06:03 user nova-compute[75206]:       <nova:owner>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:user uuid="96d76d25d6a44ebcb76b81f7cdfcd46f">tempest-TestShelveInstance-2054918139-project-member</nova:user>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:project uuid="9082216936d747e8b7e4033b96299b55">tempest-TestShelveInstance-2054918139</nova:project>
Nov 29 22:06:03 user nova-compute[75206]:       </nova:owner>
Nov 29 22:06:03 user nova-compute[75206]:       <nova:ports>
Nov 29 22:06:03 user nova-compute[75206]:         <nova:port uuid="75a20a21-ef92-4fb4-9625-ae61ff9a7a24">
Nov 29 22:06:03 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 22:06:03 user nova-compute[75206]:         </nova:port>
Nov 29 22:06:03 user nova-compute[75206]:       </nova:ports>
Nov 29 22:06:03 user nova-compute[75206]:     </nova:instance>
Nov 29 22:06:03 user nova-compute[75206]:   </metadata>
Nov 29 22:06:03 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:06:03 user nova-compute[75206]:     <system>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="serial">69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</entry>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="uuid">69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4</entry>
Nov 29 22:06:03 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:06:03 user nova-compute[75206]:     </system>
Nov 29 22:06:03 user nova-compute[75206]:   </sysinfo>
Nov 29 22:06:03 user nova-compute[75206]:   <os>
Nov 29 22:06:03 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:06:03 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:06:03 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:06:03 user nova-compute[75206]:   </os>
Nov 29 22:06:03 user nova-compute[75206]:   <features>
Nov 29 22:06:03 user nova-compute[75206]:     <acpi/>
Nov 29 22:06:03 user nova-compute[75206]:     <apic/>
Nov 29 22:06:03 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:06:03 user nova-compute[75206]:   </features>
Nov 29 22:06:03 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:06:03 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:06:03 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:06:03 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:06:03 user nova-compute[75206]:   </clock>
Nov 29 22:06:03 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:06:03 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:06:03 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:06:03 user nova-compute[75206]:   </cpu>
Nov 29 22:06:03 user nova-compute[75206]:   <devices>
Nov 29 22:06:03 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:06:03 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:06:03 user nova-compute[75206]:       <source dev="/dev/sdd"/>
Nov 29 22:06:03 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:06:03 user nova-compute[75206]:       <serial>bffbb024-2bd9-4728-b6fc-d3ca3c2624fd</serial>
Nov 29 22:06:03 user nova-compute[75206]:     </disk>
Nov 29 22:06:03 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:06:03 user nova-compute[75206]:       <mac address="fa:16:3e:5d:28:9a"/>
Nov 29 22:06:03 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:06:03 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:06:03 user nova-compute[75206]:       <target dev="tap75a20a21-ef"/>
Nov 29 22:06:03 user nova-compute[75206]:     </interface>
Nov 29 22:06:03 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:06:03 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4/console.log" append="off"/>
Nov 29 22:06:03 user nova-compute[75206]:     </serial>
Nov 29 22:06:03 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:06:03 user nova-compute[75206]:     <video>
Nov 29 22:06:03 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:06:03 user nova-compute[75206]:     </video>
Nov 29 22:06:03 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:06:03 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:06:03 user nova-compute[75206]:     </rng>
Nov 29 22:06:03 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:06:03 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:06:03 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:06:03 user nova-compute[75206]:     </memballoon>
Nov 29 22:06:03 user nova-compute[75206]:   </devices>
Nov 29 22:06:03 user nova-compute[75206]: </domain>
Nov 29 22:06:03 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-381264103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:05:50Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG os_vif [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing instance network info cache due to event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4a8c1eb-cc54-5e24-9133-c571b9ae9019', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a20a21-ef, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a20a21-ef, col_values=(('qos', UUID('d5978e54-fc88-4b87-96ce-7667caabf913')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a20a21-ef, col_values=(('external_ids', {'iface-id': '75a20a21-ef92-4fb4-9625-ae61ff9a7a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:28:9a', 'vm-uuid': '69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: INFO os_vif [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef')
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] No VIF found with MAC fa:16:3e:5d:28:9a, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.network.neutron [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updated VIF entry in instance network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.network.neutron [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb40c46e-131c-4df7-acd4-fabf0cb86af1 req-0e98f9a1-0eb3-4227-a677-b27c29c959a2 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Instance destroyed successfully.
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lazy-loading 'resources' on Instance uuid e1e67b78-6589-4d67-b70f-96907954cb00 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1444831382',display_name='tempest-TestServerVolumeAttachmentScenario-server-1444831382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1444831382',id=38,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZHYBJvdUAhW1+avxp4PP6A2k5NVxsiP6O3rHpsZzqZ6g9RB+GpolifkHZEs5rvECynJjhfTSqQ/NN+5gZmHvKSlh7DT/Sr5rIp3eEeGggUf1Qe0y6BvnEoYI8cuHbfew==',key_name='tempest-keypair-1183905999',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2957ca1e73e846229fb7a95b5f44994d',ramdisk_id='',reservation_id='r-00a2wsr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1924217286',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1924217286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16af9212f6a8404cb84376f4b631feb1',uuid=e1e67b78-6589-4d67-b70f-96907954cb00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converting VIF {"id": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "address": "fa:16:3e:e3:e5:44", "network": {"id": "af6f7c1d-f2d8-4114-92ba-6a95cd701baf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1244335010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2957ca1e73e846229fb7a95b5f44994d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap483f2cab-10", "ovs_interfaceid": "483f2cab-108a-4dd9-b2b7-ab9a188e0899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG os_vif [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap483f2cab-10, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f91f4c42-cb57-4638-b179-8f54aa2aee08) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: INFO os_vif [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=483f2cab-108a-4dd9-b2b7-ab9a188e0899,network=Network(af6f7c1d-f2d8-4114-92ba-6a95cd701baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap483f2cab-10')
Nov 29 22:06:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Deleting instance files /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00_del
Nov 29 22:06:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Deletion of /opt/stack/data/nova/instances/e1e67b78-6589-4d67-b70f-96907954cb00_del complete
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:04 user nova-compute[75206]: INFO nova.compute.manager [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 29 22:06:04 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:06:04 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: WARNING nova.compute.manager [req-b0fd7e59-cb12-4d69-8b77-e2a9190e6732 req-985850c7-7683-4d2f-ba90-d0d9147fe534 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:06:05 user nova-compute[75206]: INFO nova.compute.claims [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Claim successful on node user
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: WARNING nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state active and task_state deleting.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: WARNING nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state active and task_state deleting.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: WARNING nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state active and task_state deleting.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-unplugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Acquiring lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] Lock "e1e67b78-6589-4d67-b70f-96907954cb00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] No waiting events found dispatching network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:05 user nova-compute[75206]: WARNING nova.compute.manager [req-24cb5751-e021-45bb-bbbd-4ad6ef831dc4 req-6721e3a9-f488-46d2-9c72-4f027266c77c service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received unexpected event network-vif-plugged-483f2cab-108a-4dd9-b2b7-ab9a188e0899 for instance with vm_state active and task_state deleting.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:05 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Took 1.02 seconds to deallocate network for instance.
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:05 user nova-compute[75206]: INFO nova.compute.manager [None req-e4c23193-8a21-47b9-8271-cc075c2b4bbe tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Get console output
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:06:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.264s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:06 user nova-compute[75206]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:06:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.policy [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93365e3c31ec424ebf2669fa2d4beb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaced007ee3b4278bb34c8bebc97bbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:06:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Creating image(s)
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "/opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "/opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "/opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.198s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.206s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.732s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk 1073741824" returned: 0 in 0.076s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:06 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Deleted allocations for instance e1e67b78-6589-4d67-b70f-96907954cb00
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8229c816-7e60-42cd-b0df-7bd2c640c7a7 tempest-TestServerVolumeAttachmentScenario-1924217286 tempest-TestServerVolumeAttachmentScenario-1924217286-project-member] Lock "e1e67b78-6589-4d67-b70f-96907954cb00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.893s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.237s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:06:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Successfully created port: 9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Cannot resize image /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Ensure instance console log exists: /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:06:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance spawned successfully.
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:07 user nova-compute[75206]: WARNING nova.compute.manager [req-a799d286-ca12-4a8a-8a61-69b312813c0e req-bb276804-f0f6-49aa-9533-d11500869a58 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:06:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-25006f0f-45bf-464e-8768-de0ee5aad9d3 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.653s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-d574e0aa-7285-422e-aab7-715b261197a3 req-5109f591-8d14-415d-ba2e-ce96f39f1961 service nova] [instance: e1e67b78-6589-4d67-b70f-96907954cb00] Received event network-vif-deleted-483f2cab-108a-4dd9-b2b7-ab9a188e0899 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Successfully updated port: 9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquired lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.neutron [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updating instance_info_cache with network_info: [{"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Releasing lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Instance network_info: |[{"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Start _get_guest_xml network_info=[{"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:06:08 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:08 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1333260',id=41,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVoozyrINMNrYsy20BOW2vj2OALr9qCsxOBfuHL5OEpx3tSN1uEKacf9g83Pl04ot5GEU45K1r3S9oQ524Ab7PnAzRN5/VQhTQQmyVF4ddh94/CpVm/ANEyZb0XovolPw==',key_name='tempest-keypair-1667258659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaced007ee3b4278bb34c8bebc97bbcb',ramdisk_id='',reservation_id='r-0y51wkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93365e3c31ec424ebf2669fa2d4beb75',uuid=c02aade4-e4e2-4d12-90aa-156c682825d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converting VIF {"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lazy-loading 'pci_devices' on Instance uuid c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:06:08 user nova-compute[75206]:   <uuid>c02aade4-e4e2-4d12-90aa-156c682825d3</uuid>
Nov 29 22:06:08 user nova-compute[75206]:   <name>instance-00000029</name>
Nov 29 22:06:08 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:06:08 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:06:08 user nova-compute[75206]:   <metadata>
Nov 29 22:06:08 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:06:08 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350</nova:name>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:06:08</nova:creationTime>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:06:08 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:06:08 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:owner>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:user uuid="93365e3c31ec424ebf2669fa2d4beb75">tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member</nova:user>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:project uuid="eaced007ee3b4278bb34c8bebc97bbcb">tempest-TestServerVolumeAttachScenarioOldVersion-1630124810</nova:project>
Nov 29 22:06:08 user nova-compute[75206]:       </nova:owner>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:06:08 user nova-compute[75206]:       <nova:ports>
Nov 29 22:06:08 user nova-compute[75206]:         <nova:port uuid="9b193f89-8d5b-4ea1-8de3-54848071d71c">
Nov 29 22:06:08 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 22:06:08 user nova-compute[75206]:         </nova:port>
Nov 29 22:06:08 user nova-compute[75206]:       </nova:ports>
Nov 29 22:06:08 user nova-compute[75206]:     </nova:instance>
Nov 29 22:06:08 user nova-compute[75206]:   </metadata>
Nov 29 22:06:08 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:06:08 user nova-compute[75206]:     <system>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="serial">c02aade4-e4e2-4d12-90aa-156c682825d3</entry>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="uuid">c02aade4-e4e2-4d12-90aa-156c682825d3</entry>
Nov 29 22:06:08 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:06:08 user nova-compute[75206]:     </system>
Nov 29 22:06:08 user nova-compute[75206]:   </sysinfo>
Nov 29 22:06:08 user nova-compute[75206]:   <os>
Nov 29 22:06:08 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:06:08 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:06:08 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:06:08 user nova-compute[75206]:   </os>
Nov 29 22:06:08 user nova-compute[75206]:   <features>
Nov 29 22:06:08 user nova-compute[75206]:     <acpi/>
Nov 29 22:06:08 user nova-compute[75206]:     <apic/>
Nov 29 22:06:08 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:06:08 user nova-compute[75206]:   </features>
Nov 29 22:06:08 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:06:08 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:06:08 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:06:08 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:06:08 user nova-compute[75206]:   </clock>
Nov 29 22:06:08 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:06:08 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:06:08 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:06:08 user nova-compute[75206]:   </cpu>
Nov 29 22:06:08 user nova-compute[75206]:   <devices>
Nov 29 22:06:08 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:06:08 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:06:08 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk"/>
Nov 29 22:06:08 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:06:08 user nova-compute[75206]:     </disk>
Nov 29 22:06:08 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:06:08 user nova-compute[75206]:       <mac address="fa:16:3e:7b:0d:5f"/>
Nov 29 22:06:08 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:06:08 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:06:08 user nova-compute[75206]:       <target dev="tap9b193f89-8d"/>
Nov 29 22:06:08 user nova-compute[75206]:     </interface>
Nov 29 22:06:08 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:06:08 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/console.log" append="off"/>
Nov 29 22:06:08 user nova-compute[75206]:     </serial>
Nov 29 22:06:08 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:06:08 user nova-compute[75206]:     <video>
Nov 29 22:06:08 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:06:08 user nova-compute[75206]:     </video>
Nov 29 22:06:08 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:06:08 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:06:08 user nova-compute[75206]:     </rng>
Nov 29 22:06:08 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:06:08 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:06:08 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:06:08 user nova-compute[75206]:     </memballoon>
Nov 29 22:06:08 user nova-compute[75206]:   </devices>
Nov 29 22:06:08 user nova-compute[75206]: </domain>
Nov 29 22:06:08 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1333260',id=41,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVoozyrINMNrYsy20BOW2vj2OALr9qCsxOBfuHL5OEpx3tSN1uEKacf9g83Pl04ot5GEU45K1r3S9oQ524Ab7PnAzRN5/VQhTQQmyVF4ddh94/CpVm/ANEyZb0XovolPw==',key_name='tempest-keypair-1667258659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaced007ee3b4278bb34c8bebc97bbcb',ramdisk_id='',reservation_id='r-0y51wkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93365e3c31ec424ebf2669fa2d4beb75',uuid=c02aade4-e4e2-4d12-90aa-156c682825d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converting VIF {"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG os_vif [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b557a194-290a-5f17-8ce5-da723235b839', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b193f89-8d, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b193f89-8d, col_values=(('qos', UUID('ba491d50-b744-43e2-bc05-e2b9ff856736')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b193f89-8d, col_values=(('external_ids', {'iface-id': '9b193f89-8d5b-4ea1-8de3-54848071d71c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:0d:5f', 'vm-uuid': 'c02aade4-e4e2-4d12-90aa-156c682825d3'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:08 user nova-compute[75206]: INFO os_vif [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d')
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:06:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] No VIF found with MAC fa:16:3e:7b:0d:5f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-changed-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Refreshing instance network info cache due to event network-changed-9b193f89-8d5b-4ea1-8de3-54848071d71c. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] Acquiring lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] Acquired lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG nova.network.neutron [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Refreshing network info cache for port 9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updated VIF entry in instance network info cache for port 9b193f89-8d5b-4ea1-8de3-54848071d71c. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updating instance_info_cache with network_info: [{"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6eff328e-6684-4c56-b0fa-c1b020563e04 req-9871b059-6862-4054-b15f-4555db6f75db service nova] Releasing lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] No waiting events found dispatching network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:10 user nova-compute[75206]: WARNING nova.compute.manager [req-40628a85-3a7d-4f0a-bb30-e66e0e1b857f req-b49aa9f1-2bb8-4a67-8d6b-8e322ecbf961 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received unexpected event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c for instance with vm_state building and task_state spawning.
Nov 29 22:06:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:06:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Instance spawned successfully.
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:06:12 user nova-compute[75206]: INFO nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 29 22:06:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] No waiting events found dispatching network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:12 user nova-compute[75206]: WARNING nova.compute.manager [req-cc1e8fca-734a-4df2-96d2-3c389374003c req-5f1fa494-e6b0-4a21-8e58-256487a841ca service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received unexpected event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c for instance with vm_state building and task_state spawning.
Nov 29 22:06:12 user nova-compute[75206]: INFO nova.compute.manager [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Took 6.77 seconds to build instance.
Nov 29 22:06:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7efc23eb-830b-4632-b67d-9ba45a71537e tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.902s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:16 user nova-compute[75206]: INFO nova.compute.manager [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Terminating instance
Nov 29 22:06:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:16 user nova-compute[75206]: DEBUG nova.compute.manager [req-0f0c737c-489e-4ae7-847b-089c97d8102c req-3ea95c2e-1974-4494-9e6e-052c3ac176f0 service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-unplugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:06:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Instance destroyed successfully.
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.objects.instance [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'resources' on Instance uuid 5cc2418b-ae38-4884-a3e1-d0311f577d75 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T21:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1574489291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1574489291',id=35,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiicWIESZg6ZA1V5akTgOlfmWCyvk8No5G04QgdDN91sEDfr2/XDfjjbD2/v1PgPvA7VINa1M7XE0t8Tg9UgAMo5TVW66u+QB+CbBVVAelegYRD87cxl/kio3EwdalrkA==',key_name='tempest-keypair-1481084862',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-nhwbffec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=5cc2418b-ae38-4884-a3e1-d0311f577d75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "address": "fa:16:3e:a7:ec:c1", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0d31a2-a6", "ovs_interfaceid": "ec0d31a2-a6f7-4d7f-b998-96b5730c9150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG os_vif [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec0d31a2-a6, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=407b703c-a016-494c-a1e3-3dd3028bc3e8) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: INFO os_vif [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:c1,bridge_name='br-int',has_traffic_filtering=True,id=ec0d31a2-a6f7-4d7f-b998-96b5730c9150,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0d31a2-a6')
Nov 29 22:06:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Deleting instance files /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75_del
Nov 29 22:06:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Deletion of /opt/stack/data/nova/instances/5cc2418b-ae38-4884-a3e1-d0311f577d75_del complete
Nov 29 22:06:17 user nova-compute[75206]: INFO nova.compute.manager [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 22:06:17 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:06:17 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Took 0.65 seconds to deallocate network for instance.
Nov 29 22:06:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:18 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Deleted allocations for instance 5cc2418b-ae38-4884-a3e1-d0311f577d75
Nov 29 22:06:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-bed84008-955a-4d93-8dc7-0cf74b5e9950 tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] Acquiring lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] Lock "5cc2418b-ae38-4884-a3e1-d0311f577d75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] No waiting events found dispatching network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:06:18 user nova-compute[75206]: WARNING nova.compute.manager [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received unexpected event network-vif-plugged-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 for instance with vm_state deleted and task_state None.
Nov 29 22:06:18 user nova-compute[75206]: DEBUG nova.compute.manager [req-8411ba7e-57d1-4608-a63f-877436084bb7 req-6f9d468e-bed8-480e-9445-7029af72227d service nova] [instance: 5cc2418b-ae38-4884-a3e1-d0311f577d75] Received event network-vif-deleted-ec0d31a2-a6f7-4d7f-b998-96b5730c9150 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:06:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:29 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:06:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=24.746105194091797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4f8772b2-6486-4082-b9f1-962b13cda528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 648e90b8-b0c6-4a64-ae14-d019848019d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 742b3d8a-d614-4c14-a04d-f000e97b4af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c02aade4-e4e2-4d12-90aa-156c682825d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:06:32 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:06:33 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:06:33 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:06:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:06:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:06:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:06:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:06:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:06:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:06:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:06:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:06:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:01 user nova-compute[75206]: INFO nova.compute.manager [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Terminating instance
Nov 29 22:07:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a8b3454-5593-4a76-ab6e-667d07e87a61 req-77fe40e2-7563-45a7-9e4e-73f8658cbf41 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-unplugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Instance destroyed successfully.
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 4f8772b2-6486-4082-b9f1-962b13cda528 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1273751997',display_name='tempest-ServerRescueNegativeTestJSON-server-1273751997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1273751997',id=20,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-o67tzilg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:52:35Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=4f8772b2-6486-4082-b9f1-962b13cda528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "address": "fa:16:3e:ce:a1:51", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3afa92ba-d3", "ovs_interfaceid": "3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG os_vif [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3afa92ba-d3, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=591dfacf-01f5-40c8-9ff4-d0a577f52f0c) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:02 user nova-compute[75206]: INFO os_vif [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:a1:51,bridge_name='br-int',has_traffic_filtering=True,id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3afa92ba-d3')
Nov 29 22:07:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Deleting instance files /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528_del
Nov 29 22:07:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Deletion of /opt/stack/data/nova/instances/4f8772b2-6486-4082-b9f1-962b13cda528_del complete
Nov 29 22:07:02 user nova-compute[75206]: INFO nova.compute.manager [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:02 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:02 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:03 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Took 0.48 seconds to deallocate network for instance.
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-513cb856-66b8-43b2-b7e2-abbcfabc52a4 req-d288aa72-1103-4ec2-8831-15394fbbeb80 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-deleted-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:03 user nova-compute[75206]: INFO nova.compute.manager [req-513cb856-66b8-43b2-b7e2-abbcfabc52a4 req-d288aa72-1103-4ec2-8831-15394fbbeb80 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Neutron deleted interface 3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0; detaching it from the instance and deleting it from the info cache
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.network.neutron [req-513cb856-66b8-43b2-b7e2-abbcfabc52a4 req-d288aa72-1103-4ec2-8831-15394fbbeb80 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-513cb856-66b8-43b2-b7e2-abbcfabc52a4 req-d288aa72-1103-4ec2-8831-15394fbbeb80 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Detach interface failed, port_id=3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0, reason: Instance 4f8772b2-6486-4082-b9f1-962b13cda528 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:03 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Deleted allocations for instance 4f8772b2-6486-4082-b9f1-962b13cda528
Nov 29 22:07:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-146067e1-0f26-4f50-a997-2453f031fcea tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "4f8772b2-6486-4082-b9f1-962b13cda528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] Acquiring lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] Lock "4f8772b2-6486-4082-b9f1-962b13cda528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] No waiting events found dispatching network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:04 user nova-compute[75206]: WARNING nova.compute.manager [req-676d4342-a0c7-4830-a1ef-2bee9ca75906 req-3e5b0bd4-9f7e-4d49-9d1c-62aa741487e7 service nova] [instance: 4f8772b2-6486-4082-b9f1-962b13cda528] Received unexpected event network-vif-plugged-3afa92ba-d3a4-49aa-bd26-2cbfcefd6fb0 for instance with vm_state deleted and task_state None.
Nov 29 22:07:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:06 user nova-compute[75206]: INFO nova.compute.manager [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Terminating instance
Nov 29 22:07:06 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-47874467-71b9-4681-96f1-bdb3fb4e5042 req-b11ae0f3-4afe-492f-ae27-660a10e652c3 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-unplugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Instance destroyed successfully.
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'resources' on Instance uuid 47df4638-2c13-4c33-8b8d-f7a5d5d3338f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-358814846',display_name='tempest-ServerActionsTestOtherA-server-358814846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-358814846',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-ppepju3x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=47df4638-2c13-4c33-8b8d-f7a5d5d3338f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "address": "fa:16:3e:b2:ed:ac", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7453adc6-89", "ovs_interfaceid": "7453adc6-895e-4bd0-8cdf-8e554a65ada7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_vif [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7453adc6-89, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4107a27f-feb1-4486-80c3-22fef53e0bfc) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:07 user nova-compute[75206]: INFO os_vif [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ed:ac,bridge_name='br-int',has_traffic_filtering=True,id=7453adc6-895e-4bd0-8cdf-8e554a65ada7,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7453adc6-89')
Nov 29 22:07:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLPHXVED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:07:07 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae385df8-562f-4bfa-9076-4a0cdc6ff5d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:07:07 user nova-compute[75206]: No targets found.
Nov 29 22:07:07 user nova-compute[75206]: iSNS:
Nov 29 22:07:07 user nova-compute[75206]: No targets found.
Nov 29 22:07:07 user nova-compute[75206]: STATIC:
Nov 29 22:07:07 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:07:07 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:07 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:07 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:07:07 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:07 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:07 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd
Nov 29 22:07:07 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:07 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:07 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c
Nov 29 22:07:07 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:07 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:07 user nova-compute[75206]: FIRMWARE:
Nov 29 22:07:07 user nova-compute[75206]: No targets found.
Nov 29 22:07:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:07:07 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:07:07 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b16425-c81d-4e10-b4eb-25d0d2295abe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f635e1-9a7b-42e6-b5f4-5934442554d8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c (non-flash)
Nov 29 22:07:07 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c9e13400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacfedfa-061d-4ba2-8fd0-6952e15e94d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72972d16-ab62-4ad7-96d9-44843f456069]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba686d05-d116-43e1-acac-c34a33e1f8f3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[678555e3-254c-4ccf-9474-53e6b5c81ad4]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b138b78', '/dev/disk/by-id/scsi-1SCST_BIO2b138b78-04d6880a2a5d0b7d', '/dev/disk/by-id/scsi-23034643638383061') {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 22:07:07 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2b138b78
Nov 29 22:07:07 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2b138b78-04d6880a2a5d0b7d
Nov 29 22:07:07 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23034643638383061
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[10934ccf-3ae7-4524-b351-3789bdc5b3eb]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[048dba11-390a-4f9e-b099-96777403bc65]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e47777-90f3-4f05-a56d-4ed118210bda]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260]
Nov 29 22:07:07 user nova-compute[75206]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c, portal: 172.16.0.220,3260] successful.
Nov 29 22:07:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:554084b0-93f5-4a09-b74b-ecdb4e78779c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e49c7d3-383a-4e8f-8a4c-1e9670d926d1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] <== disconnect_volume: return (359ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:07:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Deleting instance files /opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f_del
Nov 29 22:07:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Deletion of /opt/stack/data/nova/instances/47df4638-2c13-4c33-8b8d-f7a5d5d3338f_del complete
Nov 29 22:07:08 user nova-compute[75206]: INFO nova.compute.manager [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:08 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:08 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Took 0.71 seconds to deallocate network for instance.
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-72be3332-1b66-4a53-a791-d2d424c15740 req-cac921d8-3f09-487a-a3ec-da0bd60f7f5c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-deleted-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:08 user nova-compute[75206]: INFO nova.compute.manager [req-72be3332-1b66-4a53-a791-d2d424c15740 req-cac921d8-3f09-487a-a3ec-da0bd60f7f5c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Neutron deleted interface 7453adc6-895e-4bd0-8cdf-8e554a65ada7; detaching it from the instance and deleting it from the info cache
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.network.neutron [req-72be3332-1b66-4a53-a791-d2d424c15740 req-cac921d8-3f09-487a-a3ec-da0bd60f7f5c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-72be3332-1b66-4a53-a791-d2d424c15740 req-cac921d8-3f09-487a-a3ec-da0bd60f7f5c service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Detach interface failed, port_id=7453adc6-895e-4bd0-8cdf-8e554a65ada7, reason: Instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 22:07:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] Acquiring lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] No waiting events found dispatching network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:09 user nova-compute[75206]: WARNING nova.compute.manager [req-9272ca9e-0a04-4c6d-aaa8-368fab1a34b2 req-f418fd66-7217-4fe7-a43d-53fcf7f60f45 service nova] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Received unexpected event network-vif-plugged-7453adc6-895e-4bd0-8cdf-8e554a65ada7 for instance with vm_state active and task_state deleting.
Nov 29 22:07:09 user nova-compute[75206]: INFO nova.compute.manager [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Took 0.84 seconds to detach 1 volumes for instance.
Nov 29 22:07:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: 47df4638-2c13-4c33-8b8d-f7a5d5d3338f] Deleting volume: 554084b0-93f5-4a09-b74b-ecdb4e78779c {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:10 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:10 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:10 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Deleted allocations for instance 47df4638-2c13-4c33-8b8d-f7a5d5d3338f
Nov 29 22:07:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0037a9e4-dc76-4271-82c1-08f50735b8e4 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "47df4638-2c13-4c33-8b8d-f7a5d5d3338f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.375s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:07:11 user nova-compute[75206]: INFO nova.compute.claims [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Claim successful on node user
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:07:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.policy [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7d06116d600497090ba07fcb86ee782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fefc9dd69d944df892990a9db00c4e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:07:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Creating image(s)
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk 1073741824" returned: 0 in 0.051s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Successfully created port: fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Successfully updated port: fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing instance network info cache due to event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance network_info: |[{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start _get_guest_xml network_info=[{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:07:13 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:07:13 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjzx+aQp9485SU7v0Rf0fbQCIGbSdklzCu9WZwk/1ePybHZ0NZYo4ht9w+hEvJ5NGnunAOnMefsHXiBTf8BM9YDcv1viAn4kNwbNaznCKFiYNo+30bq4mhHphrCbaeAPA==',key_name='tempest-keypair-317493109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:07:13 user nova-compute[75206]:   <uuid>2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</uuid>
Nov 29 22:07:13 user nova-compute[75206]:   <name>instance-0000002a</name>
Nov 29 22:07:13 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:07:13 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:07:13 user nova-compute[75206]:   <metadata>
Nov 29 22:07:13 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:07:13 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-705980213</nova:name>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:07:13</nova:creationTime>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:07:13 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:07:13 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:owner>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:user uuid="e7d06116d600497090ba07fcb86ee782">tempest-AttachVolumeShelveTestJSON-700434495-project-member</nova:user>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:project uuid="0fefc9dd69d944df892990a9db00c4e8">tempest-AttachVolumeShelveTestJSON-700434495</nova:project>
Nov 29 22:07:13 user nova-compute[75206]:       </nova:owner>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:07:13 user nova-compute[75206]:       <nova:ports>
Nov 29 22:07:13 user nova-compute[75206]:         <nova:port uuid="fa4201bc-5635-4ca2-9ac8-abce9b965164">
Nov 29 22:07:13 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 22:07:13 user nova-compute[75206]:         </nova:port>
Nov 29 22:07:13 user nova-compute[75206]:       </nova:ports>
Nov 29 22:07:13 user nova-compute[75206]:     </nova:instance>
Nov 29 22:07:13 user nova-compute[75206]:   </metadata>
Nov 29 22:07:13 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:07:13 user nova-compute[75206]:     <system>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="serial">2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</entry>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="uuid">2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</entry>
Nov 29 22:07:13 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:07:13 user nova-compute[75206]:     </system>
Nov 29 22:07:13 user nova-compute[75206]:   </sysinfo>
Nov 29 22:07:13 user nova-compute[75206]:   <os>
Nov 29 22:07:13 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:07:13 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:07:13 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:07:13 user nova-compute[75206]:   </os>
Nov 29 22:07:13 user nova-compute[75206]:   <features>
Nov 29 22:07:13 user nova-compute[75206]:     <acpi/>
Nov 29 22:07:13 user nova-compute[75206]:     <apic/>
Nov 29 22:07:13 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:07:13 user nova-compute[75206]:   </features>
Nov 29 22:07:13 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:07:13 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:07:13 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:07:13 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:07:13 user nova-compute[75206]:   </clock>
Nov 29 22:07:13 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:07:13 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:07:13 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:07:13 user nova-compute[75206]:   </cpu>
Nov 29 22:07:13 user nova-compute[75206]:   <devices>
Nov 29 22:07:13 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:07:13 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:07:13 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk"/>
Nov 29 22:07:13 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:07:13 user nova-compute[75206]:     </disk>
Nov 29 22:07:13 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:07:13 user nova-compute[75206]:       <mac address="fa:16:3e:9f:0a:13"/>
Nov 29 22:07:13 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:07:13 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:07:13 user nova-compute[75206]:       <target dev="tapfa4201bc-56"/>
Nov 29 22:07:13 user nova-compute[75206]:     </interface>
Nov 29 22:07:13 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:07:13 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/console.log" append="off"/>
Nov 29 22:07:13 user nova-compute[75206]:     </serial>
Nov 29 22:07:13 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:07:13 user nova-compute[75206]:     <video>
Nov 29 22:07:13 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:07:13 user nova-compute[75206]:     </video>
Nov 29 22:07:13 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:07:13 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:07:13 user nova-compute[75206]:     </rng>
Nov 29 22:07:13 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:07:13 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:07:13 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:07:13 user nova-compute[75206]:     </memballoon>
Nov 29 22:07:13 user nova-compute[75206]:   </devices>
Nov 29 22:07:13 user nova-compute[75206]: </domain>
Nov 29 22:07:13 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjzx+aQp9485SU7v0Rf0fbQCIGbSdklzCu9WZwk/1ePybHZ0NZYo4ht9w+hEvJ5NGnunAOnMefsHXiBTf8BM9YDcv1viAn4kNwbNaznCKFiYNo+30bq4mhHphrCbaeAPA==',key_name='tempest-keypair-317493109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG os_vif [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbe4d46-cb53-5e7d-8e93-fdfe616c16b5', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4201bc-56, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4201bc-56, col_values=(('qos', UUID('d859148c-f1ce-492f-84fd-aa73bb3be66e')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4201bc-56, col_values=(('external_ids', {'iface-id': 'fa4201bc-5635-4ca2-9ac8-abce9b965164', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:0a:13', 'vm-uuid': '2bf4b75b-e4fe-449a-93b0-4f5dc64228d3'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:13 user nova-compute[75206]: INFO os_vif [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56')
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No VIF found with MAC fa:16:3e:9f:0a:13, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updated VIF entry in instance network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a48414de-94b0-4f18-b2a1-4cf3dc52c0f9 req-7217ca78-d6b9-438d-bbdb-45ffa507aa99 service nova] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:07:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:15 user nova-compute[75206]: WARNING nova.compute.manager [req-04c771b2-4e6f-4093-9c29-1117f3ab6d9f req-86f9bb38-57af-4596-af98-7d1ead12f556 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state building and task_state spawning.
Nov 29 22:07:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:07:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance spawned successfully.
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:07:17 user nova-compute[75206]: INFO nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:07:17 user nova-compute[75206]: INFO nova.compute.manager [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Took 6.06 seconds to build instance.
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:17 user nova-compute[75206]: WARNING nova.compute.manager [req-f83ed8e2-23dc-4ab2-8e8e-12e3755a4e98 req-dfa1ade0-5aab-4250-9e31-b98de2168dd0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state active and task_state None.
Nov 29 22:07:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5180f719-30d8-4bde-8926-b85240e8616d tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.186s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:19 user nova-compute[75206]: INFO nova.compute.manager [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Terminating instance
Nov 29 22:07:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-unplugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] No waiting events found dispatching network-vif-unplugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-170fd2a5-7f10-4253-b7d5-c831fef0b630 req-0257d29f-77d3-4dc8-84f0-600b5dff9c8a service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-unplugged-e523b35a-eccb-48c0-82b9-f6206000d47e for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Instance destroyed successfully.
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.objects.instance [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'resources' on Instance uuid 742b3d8a-d614-4c14-a04d-f000e97b4af4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:02:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1928483505',display_name='tempest-VolumesSnapshotTestJSON-instance-1928483505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1928483505',id=40,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw5FZST02F/CgTDKqv9Vi7NVhpbiKs2T/9lrB9njap0Udw4ivj4EJTBzszmiQ4nZdG7Zn6YNoKXPzgNMy9MYlyrB8b8LVR0To4Ceauf67Co7p2xGtePYQXzI30+8zjeNw==',key_name='tempest-keypair-1768950190',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-7q9mawi1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=742b3d8a-d614-4c14-a04d-f000e97b4af4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "e523b35a-eccb-48c0-82b9-f6206000d47e", "address": "fa:16:3e:05:23:f0", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape523b35a-ec", "ovs_interfaceid": "e523b35a-eccb-48c0-82b9-f6206000d47e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG os_vif [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape523b35a-ec, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6c920f7-3a4d-4d24-af85-95025986ea66) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:20 user nova-compute[75206]: INFO os_vif [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:23:f0,bridge_name='br-int',has_traffic_filtering=True,id=e523b35a-eccb-48c0-82b9-f6206000d47e,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape523b35a-ec')
Nov 29 22:07:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Deleting instance files /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4_del
Nov 29 22:07:20 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Deletion of /opt/stack/data/nova/instances/742b3d8a-d614-4c14-a04d-f000e97b4af4_del complete
Nov 29 22:07:20 user nova-compute[75206]: INFO nova.compute.manager [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:20 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:20 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:21 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Took 0.72 seconds to deallocate network for instance.
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:21 user nova-compute[75206]: INFO nova.compute.manager [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Terminating instance
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:21 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Deleted allocations for instance 742b3d8a-d614-4c14-a04d-f000e97b4af4
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-401024f0-9c48-4bec-baf6-c51cd8eb8382 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Acquiring lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Lock "742b3d8a-d614-4c14-a04d-f000e97b4af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] No waiting events found dispatching network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:21 user nova-compute[75206]: WARNING nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received unexpected event network-vif-plugged-e523b35a-eccb-48c0-82b9-f6206000d47e for instance with vm_state deleted and task_state None.
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 742b3d8a-d614-4c14-a04d-f000e97b4af4] Received event network-vif-deleted-e523b35a-eccb-48c0-82b9-f6206000d47e {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-19099a3a-4fa4-4be8-91d2-bd5e05c5f2ee req-2a737522-456b-4050-9bbc-0ff69782f887 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Instance destroyed successfully.
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid 648e90b8-b0c6-4a64-ae14-d019848019d9 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:01:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1746192216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1746192216',id=37,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:03:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-t3gust4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:05:35Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=648e90b8-b0c6-4a64-ae14-d019848019d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "address": "fa:16:3e:ee:f4:c1", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8928f1-cb", "ovs_interfaceid": "4a8928f1-cbe4-4d06-9570-173b2ed0e8c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_vif [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a8928f1-cb, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=290960bf-c3f8-4be3-9682-dff68ae8e042) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: INFO os_vif [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f4:c1,bridge_name='br-int',has_traffic_filtering=True,id=4a8928f1-cbe4-4d06-9570-173b2ed0e8c1,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8928f1-cb')
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxmOHDdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:07:22 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5e3e9-8e82-40d6-9d7a-460794eb4048]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:07:22 user nova-compute[75206]: No targets found.
Nov 29 22:07:22 user nova-compute[75206]: iSNS:
Nov 29 22:07:22 user nova-compute[75206]: No targets found.
Nov 29 22:07:22 user nova-compute[75206]: STATIC:
Nov 29 22:07:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:07:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c
Nov 29 22:07:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd
Nov 29 22:07:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:22 user nova-compute[75206]: FIRMWARE:
Nov 29 22:07:22 user nova-compute[75206]: No targets found.
Nov 29 22:07:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:07:22 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:07:22 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d382f-6726-4eea-afc5-a5cfa997fe0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48c605-13a8-4397-90d8-0ce462b24436]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:22 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:07:22 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:22 user nova-compute[75206]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c (non-flash)
Nov 29 22:07:22 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8226cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c'): ({'sdf'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Removing single pathed devices sdf {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee43370c-1f26-4dfa-99e0-cd25a583a579]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d91398-d417-452e-acd1-5d44183d5a20]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flushing IO for device /dev/sdf {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c0fb8-35b7-4fd2-8a51-0f9c96228d9e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29934d3c-891f-48a3-b727-6cf01c9cb715]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] SCSI volumes sdf have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO47b1e51e-665a7c3462b56078', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47b1e51e', '/dev/disk/by-id/scsi-23636356137633334') {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 22:07:22 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO47b1e51e-665a7c3462b56078
Nov 29 22:07:22 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_47b1e51e
Nov 29 22:07:22 user nova-compute[75206]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23636356137633334
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee5dcaa-3b7f-48bf-a889-2e65502420ac]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b61d9-82e5-4829-a516-3492fa2229d0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9a21a-42ef-4c84-9dd0-92803c3339fd]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260]
Nov 29 22:07:22 user nova-compute[75206]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c, portal: 172.16.0.220,3260] successful.
Nov 29 22:07:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713bc077-ce30-40d8-a8b7-3e17c4968b4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e3d8c-d948-473e-8fc6-143c371f6180]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== disconnect_volume: return (377ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:07:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Deleting instance files /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9_del
Nov 29 22:07:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Deletion of /opt/stack/data/nova/instances/648e90b8-b0c6-4a64-ae14-d019848019d9_del complete
Nov 29 22:07:22 user nova-compute[75206]: INFO nova.compute.manager [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:22 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:23 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Took 0.91 seconds to deallocate network for instance.
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:23 user nova-compute[75206]: WARNING nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state deleting.
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:23 user nova-compute[75206]: WARNING nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state deleting.
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:23 user nova-compute[75206]: WARNING nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state deleting.
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-unplugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Acquiring lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] No waiting events found dispatching network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:23 user nova-compute[75206]: WARNING nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received unexpected event network-vif-plugged-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 for instance with vm_state active and task_state deleting.
Nov 29 22:07:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-7bc04a06-88bb-46e0-bbbb-a01e6ad2b3f4 req-8ce7f61a-1703-46b5-bdba-acaabb6de775 service nova] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Received event network-vif-deleted-4a8928f1-cbe4-4d06-9570-173b2ed0e8c1 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:24 user nova-compute[75206]: INFO nova.compute.manager [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 648e90b8-b0c6-4a64-ae14-d019848019d9] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 22:07:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:24 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:24 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:24 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Deleted allocations for instance 648e90b8-b0c6-4a64-ae14-d019848019d9
Nov 29 22:07:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-85936b77-d765-4cd4-b635-81592d1cfcc0 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "648e90b8-b0c6-4a64-ae14-d019848019d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.595s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:07:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:07:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=7894MB free_disk=24.762691497802734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b42a980d-ff5c-4afb-82ab-edef2a55512f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance f5314b05-629e-4844-9496-f8e23c5c2e01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c02aade4-e4e2-4d12-90aa-156c682825d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:07:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:37 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [{"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b42a980d-ff5c-4afb-82ab-edef2a55512f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:07:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:07:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing instance network info cache due to event network-changed-75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] Acquiring lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] Acquired lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Refreshing network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:41 user nova-compute[75206]: INFO nova.compute.manager [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Terminating instance
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.compute.manager [req-8143a515-1ea7-4803-a2ec-7b37c8291320 req-b39fb8c2-f8dc-4417-a4f6-9384b7df40c8 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updated VIF entry in instance network info cache for port 75a20a21-ef92-4fb4-9625-ae61ff9a7a24. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG nova.network.neutron [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [{"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fe84064a-03f5-4803-8ce5-ca4ef82486e6 req-0996735b-954d-4d67-ac08-79df32ec4bf3 service nova] Releasing lock "refresh_cache-69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:07:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Instance destroyed successfully.
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lazy-loading 'resources' on Instance uuid 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:02:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1900707054',display_name='tempest-TestShelveInstance-server-1900707054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1900707054',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGF540cV/0ZM0hiFndiPUc2lnIxULHMgn2agKvc9uCojVqUaqEf4eDF+KtkQiDQSxpQSL5bygWcXo3Qg3L7tHi4pPv6GLyOxXgBEJ+4JxEeIeEsqRYygb1s1SHpDa4IJ3g==',key_name='tempest-TestShelveInstance-381264103',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9082216936d747e8b7e4033b96299b55',ramdisk_id='',reservation_id='r-yv0r44cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2054918139',owner_user_name='tempest-TestShelveInstance-2054918139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:06:07Z,user_data=None,user_id='96d76d25d6a44ebcb76b81f7cdfcd46f',uuid=69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converting VIF {"id": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "address": "fa:16:3e:5d:28:9a", "network": {"id": "8c083d49-5a9f-41dc-bd16-0d34ff0ceba7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570688800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9082216936d747e8b7e4033b96299b55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a20a21-ef", "ovs_interfaceid": "75a20a21-ef92-4fb4-9625-ae61ff9a7a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_vif [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a20a21-ef, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5978e54-fc88-4b87-96ce-7667caabf913) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: INFO os_vif [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:28:9a,bridge_name='br-int',has_traffic_filtering=True,id=75a20a21-ef92-4fb4-9625-ae61ff9a7a24,network=Network(8c083d49-5a9f-41dc-bd16-0d34ff0ceba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a20a21-ef')
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQIuEygh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:07:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f7826-db94-4b11-8024-cad3a43a3119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:07:42 user nova-compute[75206]: No targets found.
Nov 29 22:07:42 user nova-compute[75206]: iSNS:
Nov 29 22:07:42 user nova-compute[75206]: No targets found.
Nov 29 22:07:42 user nova-compute[75206]: STATIC:
Nov 29 22:07:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:07:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd
Nov 29 22:07:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:07:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:07:42 user nova-compute[75206]: FIRMWARE:
Nov 29 22:07:42 user nova-compute[75206]: No targets found.
Nov 29 22:07:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:07:42 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:07:42 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[588576ed-242b-4f66-be4c-ae57bd13ca5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca0da45-44f6-4230-a9b9-7af08a31d211]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:42 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:07:42 user nova-compute[75206]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd (non-flash)
Nov 29 22:07:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498626710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3dcae-8346-4fd2-9e69-d452060656dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd77ab4-3604-461c-ab55-7f076e75e435]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1e3a4-bbdf-485d-8a55-bd26132e1707]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ec37b-fa2f-46f0-be10-0756d165aa36]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509c90a-1730-43ff-a62b-08fcd4052abd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7aefe-dd73-4287-ad87-519c97911603]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260]
Nov 29 22:07:42 user nova-compute[75206]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd, portal: 172.16.0.220,3260] successful.
Nov 29 22:07:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bffbb024-2bd9-4728-b6fc-d3ca3c2624fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f97c97-93be-46e3-b8f9-08c2c061e7b8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] <== disconnect_volume: return (347ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:07:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deleting instance files /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4_del
Nov 29 22:07:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deletion of /opt/stack/data/nova/instances/69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4_del complete
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: INFO nova.compute.manager [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:42 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:42 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Took 0.41 seconds to deallocate network for instance.
Nov 29 22:07:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-fb4b0e62-1b78-4eae-8e8d-2254f1fada1e req-ea6c9ba4-8352-4dd0-a75d-96354e79da82 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-deleted-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: INFO nova.compute.manager [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Deleting volume: bffbb024-2bd9-4728-b6fc-d3ca3c2624fd {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:43 user nova-compute[75206]: WARNING nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state deleting.
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:43 user nova-compute[75206]: WARNING nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state deleting.
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:43 user nova-compute[75206]: WARNING nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state deleting.
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-unplugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Acquiring lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] No waiting events found dispatching network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:43 user nova-compute[75206]: WARNING nova.compute.manager [req-2705376b-06ee-4a4d-a65c-482d96e7c1bb req-dd734047-c55d-4207-a041-1bed168b6793 service nova] [instance: 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4] Received unexpected event network-vif-plugged-75a20a21-ef92-4fb4-9625-ae61ff9a7a24 for instance with vm_state active and task_state deleting.
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:44 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Deleted allocations for instance 69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4
Nov 29 22:07:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c84a9724-7fcb-4509-8e32-dbf41fd5cff1 tempest-TestShelveInstance-2054918139 tempest-TestShelveInstance-2054918139-project-member] Lock "69fcb2f4-4e2c-4da3-bae6-cf8cda79baa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.917s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:07:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:52 user nova-compute[75206]: INFO nova.compute.manager [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Terminating instance
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a31805b-d54d-45b8-852a-96e5cf881ebb req-a3691a11-87a7-419d-8b46-da6dddc69ac4 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-unplugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:07:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Instance destroyed successfully.
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.objects.instance [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lazy-loading 'resources' on Instance uuid 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1534183753',display_name='tempest-ServerRescueNegativeTestJSON-server-1534183753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1534183753',id=19,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e3eac3db4a4ca09a436c696b50ada2',ramdisk_id='',reservation_id='r-18urr8hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-527018362',owner_user_name='tempest-ServerRescueNegativeTestJSON-527018362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:57:22Z,user_data=None,user_id='93bf49b7d7334849ae0ed9632fa3c508',uuid=6911f6f7-402e-4e43-9b0f-97cc3fd73f9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converting VIF {"id": "21862692-e750-499a-8a72-0ec3b9498c14", "address": "fa:16:3e:d7:5e:10", "network": {"id": "fe3a0013-8c87-40b4-ad97-77301cf4f6cf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-729846502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e3eac3db4a4ca09a436c696b50ada2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21862692-e7", "ovs_interfaceid": "21862692-e750-499a-8a72-0ec3b9498c14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG os_vif [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21862692-e7, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0d993c7-1c93-48ef-9ac7-cfaa973ab405) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:52 user nova-compute[75206]: INFO os_vif [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5e:10,bridge_name='br-int',has_traffic_filtering=True,id=21862692-e750-499a-8a72-0ec3b9498c14,network=Network(fe3a0013-8c87-40b4-ad97-77301cf4f6cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21862692-e7')
Nov 29 22:07:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Deleting instance files /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e_del
Nov 29 22:07:52 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Deletion of /opt/stack/data/nova/instances/6911f6f7-402e-4e43-9b0f-97cc3fd73f9e_del complete
Nov 29 22:07:52 user nova-compute[75206]: INFO nova.compute.manager [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 29 22:07:52 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:07:52 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:07:53 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:53 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Took 0.41 seconds to deallocate network for instance.
Nov 29 22:07:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:53 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:07:53 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:07:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:53 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Deleted allocations for instance 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e
Nov 29 22:07:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccc537da-004f-4a42-af45-ece19ea2c132 tempest-ServerRescueNegativeTestJSON-527018362 tempest-ServerRescueNegativeTestJSON-527018362-project-member] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.521s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] Acquiring lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] Lock "6911f6f7-402e-4e43-9b0f-97cc3fd73f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] No waiting events found dispatching network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:07:54 user nova-compute[75206]: WARNING nova.compute.manager [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received unexpected event network-vif-plugged-21862692-e750-499a-8a72-0ec3b9498c14 for instance with vm_state deleted and task_state None.
Nov 29 22:07:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-5eeeba61-bc39-4d7f-8848-002976d0a2ff req-4f1f5a64-47c2-430c-85e6-6482b84c0fb2 service nova] [instance: 6911f6f7-402e-4e43-9b0f-97cc3fd73f9e] Received event network-vif-deleted-21862692-e750-499a-8a72-0ec3b9498c14 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-changed-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Refreshing instance network info cache due to event network-changed-9b193f89-8d5b-4ea1-8de3-54848071d71c. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] Acquiring lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] Acquired lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Refreshing network info cache for port 9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updated VIF entry in instance network info cache for port 9b193f89-8d5b-4ea1-8de3-54848071d71c. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:07:56 user nova-compute[75206]: DEBUG nova.network.neutron [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updating instance_info_cache with network_info: [{"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:07:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ebd8b2e8-e826-4e14-9c76-13656804343a req-2dc02441-edf0-451e-a5f1-0d706e1aede8 service nova] Releasing lock "refresh_cache-c02aade4-e4e2-4d12-90aa-156c682825d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:07:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lazy-loading 'flavor' on Instance uuid c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:07:59 user nova-compute[75206]: INFO nova.compute.manager [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Attaching volume 1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 to /dev/vdb
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.utils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c882b6d-8c0b-4b51-a18a-2509376db1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091c7c7-3aa9-463e-a5e4-5f53fedecf84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fdba8-f683-47a4-b9e4-8ddaed330d40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6999a-7d72-499a-a92f-73b13bdb1e30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:07:59 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:07:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bbc24-9bff-4e50-9f18-f391fd759433]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG os_brick.utils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:07:59 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updating existing volume attachment record: 500b2c49-adc9-45bc-aec9-ee8de0a7200e {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:01 user nova-compute[75206]: INFO nova.compute.manager [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Terminating instance
Nov 29 22:08:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-unplugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] No waiting events found dispatching network-vif-unplugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-942de138-ff9f-4940-9b44-fe79403ac088 req-a7333a7e-17c5-4f55-b39e-b5526c2535b7 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-unplugged-ad856788-4434-42d5-b2c1-dfd545ff286f for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Instance destroyed successfully.
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lazy-loading 'resources' on Instance uuid b42a980d-ff5c-4afb-82ab-edef2a55512f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2055333954',display_name='tempest-ServerActionsTestOtherA-server-2055333954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2055333954',id=14,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPRQ+SEisuOwkWQ4OwMdO5K0xb0KYdyuj6ZNzfxOt63msBvQgh3QiGedlZIVzz4ZEnz6ijmGftGGXd/7ja1OOk6hzncgeLDoTZqNm3YhsWd5dh//D4YsAG6vZFl9X/Ig==',key_name='tempest-keypair-1023657150',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='feaa0640f6b84a71b856782e45ca4adf',ramdisk_id='',reservation_id='r-xisu8ic0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2043072317',owner_user_name='tempest-ServerActionsTestOtherA-2043072317-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656a5b2470e14813b3060d41b1d61095',uuid=b42a980d-ff5c-4afb-82ab-edef2a55512f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converting VIF {"id": "ad856788-4434-42d5-b2c1-dfd545ff286f", "address": "fa:16:3e:96:f9:81", "network": {"id": "7972791f-b41b-412d-ad85-3548e04fa301", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1766499051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "feaa0640f6b84a71b856782e45ca4adf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad856788-44", "ovs_interfaceid": "ad856788-4434-42d5-b2c1-dfd545ff286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG os_vif [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad856788-44, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5341f9c7-666a-4e51-8a3e-95e872e66632) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:02 user nova-compute[75206]: INFO os_vif [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:81,bridge_name='br-int',has_traffic_filtering=True,id=ad856788-4434-42d5-b2c1-dfd545ff286f,network=Network(7972791f-b41b-412d-ad85-3548e04fa301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad856788-44')
Nov 29 22:08:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Deleting instance files /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f_del
Nov 29 22:08:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Deletion of /opt/stack/data/nova/instances/b42a980d-ff5c-4afb-82ab-edef2a55512f_del complete
Nov 29 22:08:02 user nova-compute[75206]: INFO nova.compute.manager [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 22:08:02 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:08:02 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:03 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Took 0.44 seconds to deallocate network for instance.
Nov 29 22:08:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-b4786821-0926-4ae4-9e58-ef3cf1089686 req-df1cbf71-9770-4f33-95c4-4b3d77332f8c service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-deleted-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:08:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:03 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Deleted allocations for instance b42a980d-ff5c-4afb-82ab-edef2a55512f
Nov 29 22:08:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7cf1029b-a277-4d21-8ebf-70cd26ddc8b3 tempest-ServerActionsTestOtherA-2043072317 tempest-ServerActionsTestOtherA-2043072317-project-member] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] Acquiring lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] Lock "b42a980d-ff5c-4afb-82ab-edef2a55512f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] No waiting events found dispatching network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:04 user nova-compute[75206]: WARNING nova.compute.manager [req-b43285ad-4aca-4d37-9c5b-0a4eb879e64f req-b8b9fb10-edac-432b-a0cd-d1bc12d8db93 service nova] [instance: b42a980d-ff5c-4afb-82ab-edef2a55512f] Received unexpected event network-vif-plugged-ad856788-4434-42d5-b2c1-dfd545ff286f for instance with vm_state deleted and task_state None.
Nov 29 22:08:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQcSThIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:08:07 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:08:07 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:08:07 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de79a5c-44ce-43bb-b2ca-44cb17ab7827]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:08:07 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab6e6b-29ba-4892-8239-a9054bf72dd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4] added
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de69894-6b96-4eb3-8b49-05bb07c91829]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[271af1b3-6c55-4889-8fa0-8ec5a00fdd5c]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQcSThIa {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQcSThIa" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c1863e-adad-47d4-85c7-54641b9775bb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQcSThIa'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccf67d1-d122-4b50-bd95-03e4b5d5b68d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dddee2-09bd-4ce9-87b0-4190b9599872]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c43082-7973-4add-bdfc-8f56dcfbc2e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260]
Nov 29 22:08:07 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260] successful.
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4adace-3ba7-446b-8903-8cece4c97737]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda46853-222a-4e83-b0d1-53729f974961]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)
Nov 29 22:08:07 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58984fdc-d6cc-479e-9e20-483da01e2ae6]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQcSThIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26461663065393366', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461663065393366', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lazy-loading 'flavor' on Instance uuid c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:08:08 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:08:08 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:08:08 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:08:08 user nova-compute[75206]:   <serial>1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4</serial>
Nov 29 22:08:08 user nova-compute[75206]: </disk>
Nov 29 22:08:08 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] No VIF found with MAC fa:16:3e:7b:0d:5f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:08:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b15b4e4b-de1d-4817-aa35-f6a298d983af tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.593s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:09 user nova-compute[75206]: INFO nova.compute.manager [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Detaching volume 1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4
Nov 29 22:08:09 user nova-compute[75206]: INFO nova.virt.block_device [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Attempting to driver detach volume 1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 from mountpoint /dev/vdb
Nov 29 22:08:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Attempting to detach device vdb from instance c02aade4-e4e2-4d12-90aa-156c682825d3 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:08:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:08:09 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:08:09 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:08:09 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:08:09 user nova-compute[75206]:   <serial>1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4</serial>
Nov 29 22:08:09 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:08:09 user nova-compute[75206]: </disk>
Nov 29 22:08:09 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:08:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Successfully detached device vdb from instance c02aade4-e4e2-4d12-90aa-156c682825d3 from the persistent domain config.
Nov 29 22:08:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c02aade4-e4e2-4d12-90aa-156c682825d3 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:08:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:08:09 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:08:09 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:08:09 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:08:09 user nova-compute[75206]:   <serial>1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4</serial>
Nov 29 22:08:09 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:08:09 user nova-compute[75206]: </disk>
Nov 29 22:08:09 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:08:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:12 user nova-compute[75206]: INFO nova.compute.manager [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Terminating instance
Nov 29 22:08:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-unplugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] No waiting events found dispatching network-vif-unplugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-ade5a43f-e208-401e-ae74-8d72bd333da7 req-add2c9e1-688e-4ff0-bc28-80ea47f84fbd service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-unplugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Instance destroyed successfully.
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.objects.instance [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid f5314b05-629e-4844-9496-f8e23c5c2e01 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1714751608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1714751608',id=32,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-kggoinhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:00:46Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=f5314b05-629e-4844-9496-f8e23c5c2e01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "address": "fa:16:3e:ac:4c:13", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe750adb-f6", "ovs_interfaceid": "be750adb-f6c6-43f9-8ccd-f0c3879add04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG os_vif [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe750adb-f6, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41b4757a-c93f-46aa-849c-7f6a81b77e05) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:13 user nova-compute[75206]: INFO os_vif [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:4c:13,bridge_name='br-int',has_traffic_filtering=True,id=be750adb-f6c6-43f9-8ccd-f0c3879add04,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe750adb-f6')
Nov 29 22:08:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Deleting instance files /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01_del
Nov 29 22:08:13 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Deletion of /opt/stack/data/nova/instances/f5314b05-629e-4844-9496-f8e23c5c2e01_del complete
Nov 29 22:08:13 user nova-compute[75206]: INFO nova.compute.manager [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 22:08:13 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:13 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Took 0.43 seconds to deallocate network for instance.
Nov 29 22:08:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:08:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:14 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Deleted allocations for instance f5314b05-629e-4844-9496-f8e23c5c2e01
Nov 29 22:08:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-75c90d71-215a-4862-8111-0a8cab4874ae tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.750s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] Acquiring lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] Lock "f5314b05-629e-4844-9496-f8e23c5c2e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] No waiting events found dispatching network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:14 user nova-compute[75206]: WARNING nova.compute.manager [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received unexpected event network-vif-plugged-be750adb-f6c6-43f9-8ccd-f0c3879add04 for instance with vm_state deleted and task_state None.
Nov 29 22:08:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-46c2c1b7-ed33-45a1-903d-d391591195bf req-4b5cb609-0b60-4150-a4a2-5816740ec644 service nova] [instance: f5314b05-629e-4844-9496-f8e23c5c2e01] Received event network-vif-deleted-be750adb-f6c6-43f9-8ccd-f0c3879add04 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c02aade4-e4e2-4d12-90aa-156c682825d3 is timed out.
Nov 29 22:08:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Successfully detached device vdb from instance c02aade4-e4e2-4d12-90aa-156c682825d3 from the live domain config.
Nov 29 22:08:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQcSThIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:08:30 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80635f04-b5dc-439f-86cc-d75c6ca7bba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:08:30 user nova-compute[75206]: No targets found.
Nov 29 22:08:30 user nova-compute[75206]: iSNS:
Nov 29 22:08:30 user nova-compute[75206]: No targets found.
Nov 29 22:08:30 user nova-compute[75206]: STATIC:
Nov 29 22:08:30 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:08:30 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:08:30 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:08:30 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4
Nov 29 22:08:30 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:08:30 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:08:30 user nova-compute[75206]: FIRMWARE:
Nov 29 22:08:30 user nova-compute[75206]: No targets found.
Nov 29 22:08:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:08:30 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:08:30 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ec108-c946-4bfa-ae1f-ff34a4302ac6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c38550-d3c8-4fc0-b08e-504e77cd20cd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:30 user nova-compute[75206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)
Nov 29 22:08:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:08:30 user nova-compute[75206]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 (non-flash)
Nov 29 22:08:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8079630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30944dc2-83f3-48ff-8770-5ebd34acebde]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8029ff-aa18-4fae-866d-1b4c0d993d46]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b939ae4-48e2-461b-b7a6-15707e60a7ca]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b22899-f934-451e-add5-6ae1db2131e0]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c64d2-67d1-471e-b6a4-9b09cecfbbcf]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0360fd3-e368-492d-a34c-a6f278275e0d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260]
Nov 29 22:08:30 user nova-compute[75206]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4, portal: 172.16.0.220,3260] successful.
Nov 29 22:08:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e1a2cf8-e1b1-47a9-b0cf-94a9e58de5e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a733f8-68db-45bc-91a5-db452527a1f3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] <== disconnect_volume: return (295ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:30 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:08:30 user nova-compute[75206]: INFO nova.compute.claims [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Claim successful on node user
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:08:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.policy [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd4014bdbbf4434ab64a764f95c5767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97782e20f03429793d463cae864c17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:08:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Creating image(s)
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "/opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "/opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lazy-loading 'flavor' on Instance uuid c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-54f7eb26-bb37-4b7e-9a8d-fbf36f8141cf tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.748s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk 1073741824" returned: 0 in 0.063s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Successfully created port: 8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:08:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Cannot resize image /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Ensure instance console log exists: /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Successfully updated port: 8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquired lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-changed-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.compute.manager [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Refreshing instance network info cache due to event network-changed-8f83c007-b4fd-4cd1-8f90-21421dca750d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] Acquiring lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.neutron [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating instance_info_cache with network_info: [{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Releasing lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Instance network_info: |[{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] Acquired lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Refreshing network info cache for port 8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Start _get_guest_xml network_info=[{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:08:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:32 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289691179',display_name='tempest-VolumesSnapshotTestJSON-instance-1289691179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289691179',id=43,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqCoTB6bw5cGttr7e4A9Go3VhXu38/VM3P6ochPg1FIQBmwjnv+pmJzA7NnCvQSF2GjxmHIjtRBb8uEuRjj0s1FAkArZiZVfSRrtji7p+qg/2UBt7jHfLt4g20bdsaxeQ==',key_name='tempest-keypair-1663481186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-et850ahr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=e4efeeb0-4ebb-4c85-be3f-0aef586d9a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'pci_devices' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:08:32 user nova-compute[75206]:   <uuid>e4efeeb0-4ebb-4c85-be3f-0aef586d9a12</uuid>
Nov 29 22:08:32 user nova-compute[75206]:   <name>instance-0000002b</name>
Nov 29 22:08:32 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:08:32 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:08:32 user nova-compute[75206]:   <metadata>
Nov 29 22:08:32 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:08:32 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1289691179</nova:name>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:08:32</nova:creationTime>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:08:32 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:08:32 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:owner>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:user uuid="5cd4014bdbbf4434ab64a764f95c5767">tempest-VolumesSnapshotTestJSON-1635594989-project-member</nova:user>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:project uuid="c97782e20f03429793d463cae864c17f">tempest-VolumesSnapshotTestJSON-1635594989</nova:project>
Nov 29 22:08:32 user nova-compute[75206]:       </nova:owner>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:08:32 user nova-compute[75206]:       <nova:ports>
Nov 29 22:08:32 user nova-compute[75206]:         <nova:port uuid="8f83c007-b4fd-4cd1-8f90-21421dca750d">
Nov 29 22:08:32 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 22:08:32 user nova-compute[75206]:         </nova:port>
Nov 29 22:08:32 user nova-compute[75206]:       </nova:ports>
Nov 29 22:08:32 user nova-compute[75206]:     </nova:instance>
Nov 29 22:08:32 user nova-compute[75206]:   </metadata>
Nov 29 22:08:32 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:08:32 user nova-compute[75206]:     <system>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="serial">e4efeeb0-4ebb-4c85-be3f-0aef586d9a12</entry>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="uuid">e4efeeb0-4ebb-4c85-be3f-0aef586d9a12</entry>
Nov 29 22:08:32 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:08:32 user nova-compute[75206]:     </system>
Nov 29 22:08:32 user nova-compute[75206]:   </sysinfo>
Nov 29 22:08:32 user nova-compute[75206]:   <os>
Nov 29 22:08:32 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:08:32 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:08:32 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:08:32 user nova-compute[75206]:   </os>
Nov 29 22:08:32 user nova-compute[75206]:   <features>
Nov 29 22:08:32 user nova-compute[75206]:     <acpi/>
Nov 29 22:08:32 user nova-compute[75206]:     <apic/>
Nov 29 22:08:32 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:08:32 user nova-compute[75206]:   </features>
Nov 29 22:08:32 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:08:32 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:08:32 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:08:32 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:08:32 user nova-compute[75206]:   </clock>
Nov 29 22:08:32 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:08:32 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:08:32 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:08:32 user nova-compute[75206]:   </cpu>
Nov 29 22:08:32 user nova-compute[75206]:   <devices>
Nov 29 22:08:32 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:08:32 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:08:32 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk"/>
Nov 29 22:08:32 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:08:32 user nova-compute[75206]:     </disk>
Nov 29 22:08:32 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:08:32 user nova-compute[75206]:       <mac address="fa:16:3e:07:a2:85"/>
Nov 29 22:08:32 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:08:32 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:08:32 user nova-compute[75206]:       <target dev="tap8f83c007-b4"/>
Nov 29 22:08:32 user nova-compute[75206]:     </interface>
Nov 29 22:08:32 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:08:32 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/console.log" append="off"/>
Nov 29 22:08:32 user nova-compute[75206]:     </serial>
Nov 29 22:08:32 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:08:32 user nova-compute[75206]:     <video>
Nov 29 22:08:32 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:08:32 user nova-compute[75206]:     </video>
Nov 29 22:08:32 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:08:32 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:08:32 user nova-compute[75206]:     </rng>
Nov 29 22:08:32 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:08:32 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:08:32 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:08:32 user nova-compute[75206]:     </memballoon>
Nov 29 22:08:32 user nova-compute[75206]:   </devices>
Nov 29 22:08:32 user nova-compute[75206]: </domain>
Nov 29 22:08:32 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289691179',display_name='tempest-VolumesSnapshotTestJSON-instance-1289691179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289691179',id=43,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqCoTB6bw5cGttr7e4A9Go3VhXu38/VM3P6ochPg1FIQBmwjnv+pmJzA7NnCvQSF2GjxmHIjtRBb8uEuRjj0s1FAkArZiZVfSRrtji7p+qg/2UBt7jHfLt4g20bdsaxeQ==',key_name='tempest-keypair-1663481186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-et850ahr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=e4efeeb0-4ebb-4c85-be3f-0aef586d9a12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG os_vif [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c80f4c21-466f-5f75-9477-eadad51bd318', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f83c007-b4, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f83c007-b4, col_values=(('qos', UUID('459435c5-f12c-4425-9766-948dfabd07eb')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f83c007-b4, col_values=(('external_ids', {'iface-id': '8f83c007-b4fd-4cd1-8f90-21421dca750d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:a2:85', 'vm-uuid': 'e4efeeb0-4ebb-4c85-be3f-0aef586d9a12'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:32 user nova-compute[75206]: INFO os_vif [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4')
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:08:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No VIF found with MAC fa:16:3e:07:a2:85, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updated VIF entry in instance network info cache for port 8f83c007-b4fd-4cd1-8f90-21421dca750d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating instance_info_cache with network_info: [{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba2ca268-521a-476c-88cd-7e59eee7e352 req-908d3695-181b-4ba8-a404-3421ee5d528e service nova] Releasing lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] No waiting events found dispatching network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:34 user nova-compute[75206]: WARNING nova.compute.manager [req-138d0010-278d-4be6-9192-a741ab1e9460 req-474b6ef7-bd4f-4b72-a45a-5076522758dd service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received unexpected event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d for instance with vm_state building and task_state spawning.
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] No waiting events found dispatching network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:36 user nova-compute[75206]: WARNING nova.compute.manager [req-3f7a7178-1ddd-48c5-bd21-d1959516ce2b req-ffc834a0-f921-47db-8843-9bde552c6c03 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received unexpected event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d for instance with vm_state building and task_state spawning.
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:08:36 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:36 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8479MB free_disk=24.929935455322266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:36 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Instance spawned successfully.
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:08:36 user nova-compute[75206]: INFO nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance c02aade4-e4e2-4d12-90aa-156c682825d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:08:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:08:37 user nova-compute[75206]: INFO nova.compute.manager [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Took 6.30 seconds to build instance.
Nov 29 22:08:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0cc17d33-6fe8-48be-af3a-772e7c338a17 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.412s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [{"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-50c12935-165b-4de9-99c0-4e8ce348e6df" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:08:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:08:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:08:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:08:55 user nova-compute[75206]: INFO nova.compute.claims [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Claim successful on node user
Nov 29 22:08:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:08:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.policy [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fec00476dc9c48e589ba6105b5b5cf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edbbd3bc5d74985817fc88839c58e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:08:56 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Creating image(s)
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.199s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk 1073741824" returned: 0 in 0.055s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Successfully created port: 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Cannot resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Ensure instance console log exists: /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Successfully updated port: 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-changed-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Refreshing instance network info cache due to event network-changed-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance network_info: |[{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Refreshing network info cache for port 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:08:57 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start _get_guest_xml network_info=[{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:08:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'pci_devices' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:08:58 user nova-compute[75206]:   <uuid>b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</uuid>
Nov 29 22:08:58 user nova-compute[75206]:   <name>instance-0000002c</name>
Nov 29 22:08:58 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:08:58 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:08:58 user nova-compute[75206]:   <metadata>
Nov 29 22:08:58 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:08:58 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeTestJSON-server-904787670</nova:name>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:08:58</nova:creationTime>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:08:58 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:08:58 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:owner>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:user uuid="fec00476dc9c48e589ba6105b5b5cf7c">tempest-AttachVolumeTestJSON-1138208547-project-member</nova:user>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:project uuid="4edbbd3bc5d74985817fc88839c58e4f">tempest-AttachVolumeTestJSON-1138208547</nova:project>
Nov 29 22:08:58 user nova-compute[75206]:       </nova:owner>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:08:58 user nova-compute[75206]:       <nova:ports>
Nov 29 22:08:58 user nova-compute[75206]:         <nova:port uuid="3ecc0b5c-70ba-4fb7-b6df-80784221d4b8">
Nov 29 22:08:58 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 22:08:58 user nova-compute[75206]:         </nova:port>
Nov 29 22:08:58 user nova-compute[75206]:       </nova:ports>
Nov 29 22:08:58 user nova-compute[75206]:     </nova:instance>
Nov 29 22:08:58 user nova-compute[75206]:   </metadata>
Nov 29 22:08:58 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:08:58 user nova-compute[75206]:     <system>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="serial">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="uuid">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:08:58 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:08:58 user nova-compute[75206]:     </system>
Nov 29 22:08:58 user nova-compute[75206]:   </sysinfo>
Nov 29 22:08:58 user nova-compute[75206]:   <os>
Nov 29 22:08:58 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:08:58 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:08:58 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:08:58 user nova-compute[75206]:   </os>
Nov 29 22:08:58 user nova-compute[75206]:   <features>
Nov 29 22:08:58 user nova-compute[75206]:     <acpi/>
Nov 29 22:08:58 user nova-compute[75206]:     <apic/>
Nov 29 22:08:58 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:08:58 user nova-compute[75206]:   </features>
Nov 29 22:08:58 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:08:58 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:08:58 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:08:58 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:08:58 user nova-compute[75206]:   </clock>
Nov 29 22:08:58 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:08:58 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:08:58 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:08:58 user nova-compute[75206]:   </cpu>
Nov 29 22:08:58 user nova-compute[75206]:   <devices>
Nov 29 22:08:58 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:08:58 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:08:58 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk"/>
Nov 29 22:08:58 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:08:58 user nova-compute[75206]:     </disk>
Nov 29 22:08:58 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:08:58 user nova-compute[75206]:       <mac address="fa:16:3e:81:11:2f"/>
Nov 29 22:08:58 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:08:58 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:08:58 user nova-compute[75206]:       <target dev="tap3ecc0b5c-70"/>
Nov 29 22:08:58 user nova-compute[75206]:     </interface>
Nov 29 22:08:58 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:08:58 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/console.log" append="off"/>
Nov 29 22:08:58 user nova-compute[75206]:     </serial>
Nov 29 22:08:58 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:08:58 user nova-compute[75206]:     <video>
Nov 29 22:08:58 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:08:58 user nova-compute[75206]:     </video>
Nov 29 22:08:58 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:08:58 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:08:58 user nova-compute[75206]:     </rng>
Nov 29 22:08:58 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:08:58 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:08:58 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:08:58 user nova-compute[75206]:     </memballoon>
Nov 29 22:08:58 user nova-compute[75206]:   </devices>
Nov 29 22:08:58 user nova-compute[75206]: </domain>
Nov 29 22:08:58 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG os_vif [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '954b17b0-64a4-59c6-bc0c-7475cbeb9ae9', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ecc0b5c-70, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ecc0b5c-70, col_values=(('qos', UUID('7de736ee-9ed6-4afd-b2b8-191c4a7173ba')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ecc0b5c-70, col_values=(('external_ids', {'iface-id': '3ecc0b5c-70ba-4fb7-b6df-80784221d4b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:11:2f', 'vm-uuid': 'b46c8fed-be56-42ef-9eae-cc3a08cc3ac4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:58 user nova-compute[75206]: INFO os_vif [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No VIF found with MAC fa:16:3e:81:11:2f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updated VIF entry in instance network info cache for port 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:08:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-edd43ba8-8264-41ae-bf87-08f732919134 req-62e7fb60-b4b1-4af2-9e7e-bc7eca943af3 service nova] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:08:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:08:59 user nova-compute[75206]: WARNING nova.compute.manager [req-7896f298-1ac9-4009-90ac-35c84929f5fb req-65ed2a53-8064-4d94-ba99-52fa630774a3 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state building and task_state spawning.
Nov 29 22:09:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:01 user nova-compute[75206]: WARNING nova.compute.manager [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state building and task_state spawning.
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing instance network info cache due to event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:09:01 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance spawned successfully.
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:09:01 user nova-compute[75206]: INFO nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 29 22:09:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:09:02 user nova-compute[75206]: INFO nova.compute.manager [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Took 6.16 seconds to build instance.
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2c44fed3-abff-4c94-a7e1-07b520414c83 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.268s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updated VIF entry in instance network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG nova.network.neutron [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f27c1aaf-8db4-453b-85e5-2ee0e24894d4 req-588134da-d444-478e-b757-3c902f683f4e service nova] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:02 user nova-compute[75206]: INFO nova.compute.manager [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Terminating instance
Nov 29 22:09:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:09:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-938f5efe-0fc0-4b08-9cac-1436694a2ecc req-f28664ee-6b4c-4ebc-8c69-bf7a54f45ae4 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-unplugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Instance destroyed successfully.
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.objects.instance [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid d3083fb2-1acb-4cef-9ca0-061c1b1ab540 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-413138911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-413138911',id=27,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-01h1cyi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:57:00Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=d3083fb2-1acb-4cef-9ca0-061c1b1ab540,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "address": "fa:16:3e:c5:9e:15", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad25aa03-da", "ovs_interfaceid": "ad25aa03-da97-4b67-92c6-ffe789c5f726", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_vif [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad25aa03-da, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e303e200-4c4b-4b81-9dda-c373e7b0beff) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:03 user nova-compute[75206]: INFO os_vif [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9e:15,bridge_name='br-int',has_traffic_filtering=True,id=ad25aa03-da97-4b67-92c6-ffe789c5f726,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad25aa03-da')
Nov 29 22:09:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpRKyjYE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:09:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a9caba-0f6c-4809-8159-cb07f5e39c73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:09:03 user nova-compute[75206]: No targets found.
Nov 29 22:09:03 user nova-compute[75206]: iSNS:
Nov 29 22:09:03 user nova-compute[75206]: No targets found.
Nov 29 22:09:03 user nova-compute[75206]: STATIC:
Nov 29 22:09:03 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0
Nov 29 22:09:03 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:09:03 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:09:03 user nova-compute[75206]: FIRMWARE:
Nov 29 22:09:03 user nova-compute[75206]: No targets found.
Nov 29 22:09:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:09:03 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:09:03 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f82ef-fe40-4b0b-9863-add5a23ba6ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2070431b-3e3b-422a-9b25-110160edd416]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:09:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 (non-flash)
Nov 29 22:09:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24ca043d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d944511-7bc8-4f80-b291-b5dabb8271ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc6f766-ad97-4005-8b54-474ccd7f76c6]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5757e-2363-49b8-acbc-6d6994532a8e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:09:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[73422683-ddc3-41ab-a4c3-fd5c74ddc6f8]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[534d541d-defc-46a8-8729-d4efb6b104bd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e7191-d7c8-4315-96d4-9057b22e8707]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260]
Nov 29 22:09:04 user nova-compute[75206]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0, portal: 172.16.0.220,3260] successful.
Nov 29 22:09:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ccb91f2-1228-4db3-9d7f-02e79744c4f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f18e56-168c-496a-88b2-9150fca9587d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] <== disconnect_volume: return (315ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:09:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Deleting instance files /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540_del
Nov 29 22:09:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Deletion of /opt/stack/data/nova/instances/d3083fb2-1acb-4cef-9ca0-061c1b1ab540_del complete
Nov 29 22:09:04 user nova-compute[75206]: INFO nova.compute.manager [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:04 user nova-compute[75206]: INFO nova.compute.manager [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Terminating instance
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:04 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Took 0.52 seconds to deallocate network for instance.
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-8ed7c1a6-31f6-4f18-b32b-c58c85731467 req-ac1841c8-5ab9-4447-9863-514ff59b8eae service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-deleted-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-unplugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] No waiting events found dispatching network-vif-unplugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-9d2617dc-332a-4eae-93c8-74fbd4a2df93 req-211ba8fc-c36a-4b68-a0a9-665a88ba76b3 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-unplugged-9b193f89-8d5b-4ea1-8de3-54848071d71c for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] Acquiring lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] No waiting events found dispatching network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:05 user nova-compute[75206]: WARNING nova.compute.manager [req-2844d06f-88ce-4588-9f4f-2e15412c5393 req-053f9c89-061a-4c4a-bdaa-129f0af9bd08 service nova] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Received unexpected event network-vif-plugged-ad25aa03-da97-4b67-92c6-ffe789c5f726 for instance with vm_state active and task_state deleting.
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Instance destroyed successfully.
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lazy-loading 'resources' on Instance uuid c02aade4-e4e2-4d12-90aa-156c682825d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1333260350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1333260',id=41,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVoozyrINMNrYsy20BOW2vj2OALr9qCsxOBfuHL5OEpx3tSN1uEKacf9g83Pl04ot5GEU45K1r3S9oQ524Ab7PnAzRN5/VQhTQQmyVF4ddh94/CpVm/ANEyZb0XovolPw==',key_name='tempest-keypair-1667258659',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaced007ee3b4278bb34c8bebc97bbcb',ramdisk_id='',reservation_id='r-0y51wkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93365e3c31ec424ebf2669fa2d4beb75',uuid=c02aade4-e4e2-4d12-90aa-156c682825d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converting VIF {"id": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "address": "fa:16:3e:7b:0d:5f", "network": {"id": "22996b05-06bd-4bb7-85c1-1aa3466daddb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1854442112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaced007ee3b4278bb34c8bebc97bbcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b193f89-8d", "ovs_interfaceid": "9b193f89-8d5b-4ea1-8de3-54848071d71c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG os_vif [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b193f89-8d, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:05 user nova-compute[75206]: INFO nova.compute.manager [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: d3083fb2-1acb-4cef-9ca0-061c1b1ab540] Took 1.19 seconds to detach 1 volumes for instance.
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba491d50-b744-43e2-bc05-e2b9ff856736) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:05 user nova-compute[75206]: INFO nova.compute.manager [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Shelving
Nov 29 22:09:05 user nova-compute[75206]: INFO os_vif [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:0d:5f,bridge_name='br-int',has_traffic_filtering=True,id=9b193f89-8d5b-4ea1-8de3-54848071d71c,network=Network(22996b05-06bd-4bb7-85c1-1aa3466daddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b193f89-8d')
Nov 29 22:09:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Deleting instance files /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3_del
Nov 29 22:09:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Deletion of /opt/stack/data/nova/instances/c02aade4-e4e2-4d12-90aa-156c682825d3_del complete
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:06 user nova-compute[75206]: INFO nova.compute.manager [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:06 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Deleted allocations for instance d3083fb2-1acb-4cef-9ca0-061c1b1ab540
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-034b8760-6305-448c-b496-6ca4e762830e tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "d3083fb2-1acb-4cef-9ca0-061c1b1ab540" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance destroyed successfully.
Nov 29 22:09:06 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Beginning cold snapshot process
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:06 user nova-compute[75206]: WARNING nova.compute.manager [req-cb7d8faa-31f1-4cb1-a18f-a5e8427fca6b req-8fb1cd4b-ebf4-4cb4-9b44-63997c4a10b7 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state active and task_state shelving.
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk /opt/stack/data/nova/instances/snapshots/tmpzgtlvi0e/bcc03be3343145378a58b48fda08c17a {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] Acquiring lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] No waiting events found dispatching network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:07 user nova-compute[75206]: WARNING nova.compute.manager [req-3c78f045-ba1c-426d-b920-a804a8efaa8b req-65dbde03-3357-4053-b409-8deab094a7c5 service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received unexpected event network-vif-plugged-9b193f89-8d5b-4ea1-8de3-54848071d71c for instance with vm_state active and task_state deleting.
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:07 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Took 1.30 seconds to deallocate network for instance.
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk /opt/stack/data/nova/instances/snapshots/tmpzgtlvi0e/bcc03be3343145378a58b48fda08c17a" returned: 0 in 0.740s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:07 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Snapshot extracted, beginning image upload
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:09:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:07 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Deleted allocations for instance c02aade4-e4e2-4d12-90aa-156c682825d3
Nov 29 22:09:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-551b4b7b-7638-48f8-b26a-ff54bf687de1 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810 tempest-TestServerVolumeAttachScenarioOldVersion-1630124810-project-member] Lock "c02aade4-e4e2-4d12-90aa-156c682825d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.345s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:08 user nova-compute[75206]: WARNING nova.compute.manager [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 22:09:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-859f708a-9538-44bc-b529-b144dbb7dae7 req-b639e554-eec9-44e9-b5fa-b80e1bddf3ef service nova] [instance: c02aade4-e4e2-4d12-90aa-156c682825d3] Received event network-vif-deleted-9b193f89-8d5b-4ea1-8de3-54848071d71c {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Snapshot image upload complete
Nov 29 22:09:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:09:10 user nova-compute[75206]: INFO nova.compute.manager [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Shelve offloading
Nov 29 22:09:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance destroyed successfully.
Nov 29 22:09:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:09:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance destroyed successfully.
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'resources' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjzx+aQp9485SU7v0Rf0fbQCIGbSdklzCu9WZwk/1ePybHZ0NZYo4ht9w+hEvJ5NGnunAOnMefsHXiBTf8BM9YDcv1viAn4kNwbNaznCKFiYNo+30bq4mhHphrCbaeAPA==',key_name='tempest-keypair-317493109',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:07:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:09:10.334454',shelved_host='user',shelved_image_id='36150ae6-89dd-4267-a780-37cdcb58d42c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG os_vif [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing instance network info cache due to event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4201bc-56, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d859148c-f1ce-492f-84fd-aa73bb3be66e) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:11 user nova-compute[75206]: INFO os_vif [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56')
Nov 29 22:09:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Deleting instance files /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3_del
Nov 29 22:09:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Deletion of /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3_del complete
Nov 29 22:09:11 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Deleted allocations for instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.objects.base [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<2bf4b75b-e4fe-449a-93b0-4f5dc64228d3> lazy-loaded attributes: resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updated VIF entry in instance network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfa4201bc-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4e6a63f9-f7e1-48c1-8352-d1af20585e08 req-ff9b447c-a356-47b5-8385-e3b3e10a46d9 service nova] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:09:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c1b2a978-e587-4801-a434-eb4a7563a4db tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.955s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:09:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:09:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=24.876087188720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 50c12935-165b-4de9-99c0-4e8ce348e6df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:09:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:09:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:09:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:53 user nova-compute[75206]: INFO nova.compute.manager [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Terminating instance
Nov 29 22:09:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-unplugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] No waiting events found dispatching network-vif-unplugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.compute.manager [req-959d563d-fa6a-4d5f-80fa-343d0b5ba28f req-703525ff-ea10-4299-8afd-cd7dc2778591 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-unplugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:09:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Instance destroyed successfully.
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lazy-loading 'resources' on Instance uuid 50c12935-165b-4de9-99c0-4e8ce348e6df {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775815736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775815736',id=18,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ffcb36d26c41cd99ccb16570f285dc',ramdisk_id='',reservation_id='r-1o0384ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:52:04Z,user_data=None,user_id='d79424ddb3af406d9ed8a1626a8f03ee',uuid=50c12935-165b-4de9-99c0-4e8ce348e6df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converting VIF {"id": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "address": "fa:16:3e:a2:cb:f3", "network": {"id": "9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238730618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ffcb36d26c41cd99ccb16570f285dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d701527-a1", "ovs_interfaceid": "3d701527-a109-4ae9-ab2a-9c02c1e05e83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG os_vif [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d701527-a1, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad13466c-bd0a-4956-a827-aa6b717aa7ef) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:09:54 user nova-compute[75206]: INFO os_vif [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cb:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d701527-a109-4ae9-ab2a-9c02c1e05e83,network=Network(9bceb3c5-ad0b-4f2d-94ee-7ad689c2a3e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d701527-a1')
Nov 29 22:09:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Deleting instance files /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df_del
Nov 29 22:09:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Deletion of /opt/stack/data/nova/instances/50c12935-165b-4de9-99c0-4e8ce348e6df_del complete
Nov 29 22:09:54 user nova-compute[75206]: INFO nova.compute.manager [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 22:09:54 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:09:54 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:09:55 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Took 0.75 seconds to deallocate network for instance.
Nov 29 22:09:55 user nova-compute[75206]: DEBUG nova.compute.manager [req-a45e312a-5e9b-477f-8318-127e6478997a req-ebf924b0-ac4a-4e40-86a9-f6147f0cecb0 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-deleted-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:09:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:55 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Deleted allocations for instance 50c12935-165b-4de9-99c0-4e8ce348e6df
Nov 29 22:09:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-55629eb8-4d50-4b5a-a2bf-ebfeedd2bf62 tempest-ServerBootFromVolumeStableRescueTest-1359036287 tempest-ServerBootFromVolumeStableRescueTest-1359036287-project-member] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:09:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] Acquiring lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:09:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:09:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] Lock "50c12935-165b-4de9-99c0-4e8ce348e6df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:09:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] No waiting events found dispatching network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:09:56 user nova-compute[75206]: WARNING nova.compute.manager [req-a6664a3c-6056-4247-a441-1773063d3b65 req-1054330d-97c8-40e1-991c-4858fbe54d24 service nova] [instance: 50c12935-165b-4de9-99c0-4e8ce348e6df] Received unexpected event network-vif-plugged-3d701527-a109-4ae9-ab2a-9c02c1e05e83 for instance with vm_state deleted and task_state None.
Nov 29 22:09:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:09:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:10:19 user nova-compute[75206]: INFO nova.compute.claims [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Claim successful on node user
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:10:19 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:10:19 user nova-compute[75206]: DEBUG nova.policy [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:10:19 user nova-compute[75206]: INFO nova.virt.block_device [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Booting with volume snapshot 09a5ac4d-e7d3-4ad9-999c-0b09a5cf66aa at /dev/vda
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Successfully created port: b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Successfully updated port: b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-changed-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.compute.manager [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Refreshing instance network info cache due to event network-changed-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] Acquiring lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:20 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Updating instance_info_cache with network_info: [{"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Instance network_info: |[{"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] Acquired lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Refreshing network info cache for port b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-changed-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Refreshing instance network info cache due to event network-changed-8f83c007-b4fd-4cd1-8f90-21421dca750d. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] Acquiring lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] Acquired lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Refreshing network info cache for port 8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Updated VIF entry in instance network info cache for port b51dff57-d0f4-4a79-9ed9-88effe9cdfe4. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Updating instance_info_cache with network_info: [{"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-79fec731-8347-4d41-950b-655bf96f2a22 req-32ff27d3-cbc6-46f0-af3a-03565cfe6496 service nova] Releasing lock "refresh_cache-d7785442-a104-4157-a316-b20ff5033307" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updated VIF entry in instance network info cache for port 8f83c007-b4fd-4cd1-8f90-21421dca750d. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG nova.network.neutron [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating instance_info_cache with network_info: [{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:10:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-39708361-8a7b-4322-b592-c23ecad00bb1 req-45d75258-a330-4fa6-9d73-45e58fd8b400 service nova] Releasing lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG nova.objects.instance [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'flavor' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Ignoring supplied device name: /dev/vdb
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:22 user nova-compute[75206]: INFO nova.compute.manager [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Attaching volume 39cefaa6-bfde-403a-87f5-903d91310a8f to /dev/vdb
Nov 29 22:10:22 user nova-compute[75206]: DEBUG os_brick.utils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6c6e89-e82b-4094-af6b-ad48ec4a6a22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e81b2fe-99b9-45ff-aeb8-8898dd4fa805]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[81224b17-0ea9-409c-925c-55daba35e5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0d358-954e-4e14-bc70-7902aa9c7eb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:23 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:10:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29480791-b555-46c1-ae5d-c9abed6245ae]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG os_brick.utils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:10:23 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating existing volume attachment record: 6e65cb83-1f95-4d5c-a3e8-57522ae8cc34 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:10:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.utils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41bbe5-f48c-4d27-9a68-3a6c7b25c79e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0465d-dc36-4979-8b8a-2fa9618b9a1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c1f77d-432f-46d4-b027-3fef80132117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0999750b-caed-41e4-ab33-7c74b4609cf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:25 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:10:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0a7c21-90ea-42ec-8da4-66e8bf5bc251]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG os_brick.utils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:10:25 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Updating existing volume attachment record: a77c5755-8c76-4495-b38f-c8e9daa3545e {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:10:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGJKfzqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:30 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:30 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:30 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecf6fc-8ab3-4f22-a236-28730808ad38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:10:30 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.095s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfbaea9-ef2b-421b-ad97-08fe5339f62c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f] added
Nov 29 22:10:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0df372-c3c6-40f6-ae07-e91d54dc2b57]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0729d6-9223-4527-b8ec-531d76f6e80d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGJKfzqD {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGJKfzqD" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92e4e7-b494-4024-9a06-9fea50684104]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IGJKfzqD'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6038fe6-94b6-4a4a-811b-77c6f73df979]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbdb845-066b-4f61-b7da-dafb712eb2ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:10:30 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:10:30 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:30 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 22:10:30 user nova-compute[75206]: 
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c7fd5-5002-467a-ac51-051e6bb32100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260]
Nov 29 22:10:30 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260] successful.
Nov 29 22:10:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[118dfd06-4a36-4376-8203-1128677db3a5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d6ece-b7b5-4fd2-887a-0f6f7e63b93e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6e452-56bf-4491-8dfc-276cad595f0e]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:10:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGJKfzqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:10:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:10:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23834656434633632', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:10:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834656434633632', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:10:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'flavor' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:10:31 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:10:31 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:10:31 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:10:31 user nova-compute[75206]:   <serial>39cefaa6-bfde-403a-87f5-903d91310a8f</serial>
Nov 29 22:10:31 user nova-compute[75206]: </disk>
Nov 29 22:10:31 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:10:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:10:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:10:32 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] No VIF found with MAC fa:16:3e:07:a2:85, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:10:32 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-08efd3e1-e9ad-44d1-b069-cd63e56128a7 tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.597s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:10:33 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Creating image(s)
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Ensure instance console log exists: /opt/stack/data/nova/instances/d7785442-a104-4157-a316-b20ff5033307/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Start _get_guest_xml network_info=[{"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'a77c5755-8c76-4495-b38f-c8e9daa3545e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFKyvCgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7785442-a104-4157-a316-b20ff5033307', 'attached_at': '', 'detached_at': '', 'volume_id': '9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 'serial': '9d1b0b5d-8f61-4038-a5e2-54d5373ed819'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:10:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:10:33 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFKyvCgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:33 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:33 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c35bc9-45a3-4436-b5a7-3aeae03b3162]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:10:33 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e7715-8ccb-4e40-ae7f-f8771f49d5e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819] added
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19b2a3-89ab-4f92-9017-75f78f57b58b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d369fa33-7e73-4756-8d07-76835f7c6c1b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFKyvCgn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFKyvCgn" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e724f5-8483-4331-8d6a-b1f9aa6b54d7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFKyvCgn'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b9639-bd26-4a52-9cd6-1a679720360b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd06ac6-567a-4915-869f-ed8e14573593]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5f3ff-c0a5-4d1e-923a-0d0a35c5ed06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260]
Nov 29 22:10:33 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260] successful.
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d95b7-2dea-417f-a816-721d89a5bada]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f30c72-d1f5-4759-b00d-084bfe1fb553]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:33 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:33 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:33 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b64988-7ec2-4b0c-a1ea-b8ac5686aa25]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:10:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFKyvCgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23636613066396133', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636613066396133', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1665438073',display_name='tempest-TestVolumeBootPattern-server-1665438073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1665438073',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-keo0hmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:10:20Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=d7785442-a104-4157-a316-b20ff5033307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.objects.instance [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid d7785442-a104-4157-a316-b20ff5033307 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:10:34 user nova-compute[75206]:   <uuid>d7785442-a104-4157-a316-b20ff5033307</uuid>
Nov 29 22:10:34 user nova-compute[75206]:   <name>instance-0000002d</name>
Nov 29 22:10:34 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:10:34 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:10:34 user nova-compute[75206]:   <metadata>
Nov 29 22:10:34 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:10:34 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:10:34 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-server-1665438073</nova:name>
Nov 29 22:10:34 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:10:33</nova:creationTime>
Nov 29 22:10:34 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:10:34 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:10:34 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:10:34 user nova-compute[75206]:       <nova:owner>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:10:34 user nova-compute[75206]:       </nova:owner>
Nov 29 22:10:34 user nova-compute[75206]:       <nova:ports>
Nov 29 22:10:34 user nova-compute[75206]:         <nova:port uuid="b51dff57-d0f4-4a79-9ed9-88effe9cdfe4">
Nov 29 22:10:34 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 22:10:34 user nova-compute[75206]:         </nova:port>
Nov 29 22:10:34 user nova-compute[75206]:       </nova:ports>
Nov 29 22:10:34 user nova-compute[75206]:     </nova:instance>
Nov 29 22:10:34 user nova-compute[75206]:   </metadata>
Nov 29 22:10:34 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:10:34 user nova-compute[75206]:     <system>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="serial">d7785442-a104-4157-a316-b20ff5033307</entry>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="uuid">d7785442-a104-4157-a316-b20ff5033307</entry>
Nov 29 22:10:34 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:10:34 user nova-compute[75206]:     </system>
Nov 29 22:10:34 user nova-compute[75206]:   </sysinfo>
Nov 29 22:10:34 user nova-compute[75206]:   <os>
Nov 29 22:10:34 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:10:34 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:10:34 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:10:34 user nova-compute[75206]:   </os>
Nov 29 22:10:34 user nova-compute[75206]:   <features>
Nov 29 22:10:34 user nova-compute[75206]:     <acpi/>
Nov 29 22:10:34 user nova-compute[75206]:     <apic/>
Nov 29 22:10:34 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:10:34 user nova-compute[75206]:   </features>
Nov 29 22:10:34 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:10:34 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:10:34 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:10:34 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:10:34 user nova-compute[75206]:   </clock>
Nov 29 22:10:34 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:10:34 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:10:34 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:10:34 user nova-compute[75206]:   </cpu>
Nov 29 22:10:34 user nova-compute[75206]:   <devices>
Nov 29 22:10:34 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:10:34 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:10:34 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 22:10:34 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:10:34 user nova-compute[75206]:       <serial>9d1b0b5d-8f61-4038-a5e2-54d5373ed819</serial>
Nov 29 22:10:34 user nova-compute[75206]:     </disk>
Nov 29 22:10:34 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:10:34 user nova-compute[75206]:       <mac address="fa:16:3e:2c:2e:30"/>
Nov 29 22:10:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:10:34 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:10:34 user nova-compute[75206]:       <target dev="tapb51dff57-d0"/>
Nov 29 22:10:34 user nova-compute[75206]:     </interface>
Nov 29 22:10:34 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:10:34 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/d7785442-a104-4157-a316-b20ff5033307/console.log" append="off"/>
Nov 29 22:10:34 user nova-compute[75206]:     </serial>
Nov 29 22:10:34 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:10:34 user nova-compute[75206]:     <video>
Nov 29 22:10:34 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:10:34 user nova-compute[75206]:     </video>
Nov 29 22:10:34 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:10:34 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:10:34 user nova-compute[75206]:     </rng>
Nov 29 22:10:34 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:10:34 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:10:34 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:10:34 user nova-compute[75206]:     </memballoon>
Nov 29 22:10:34 user nova-compute[75206]:   </devices>
Nov 29 22:10:34 user nova-compute[75206]: </domain>
Nov 29 22:10:34 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1665438073',display_name='tempest-TestVolumeBootPattern-server-1665438073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1665438073',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-keo0hmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:10:20Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=d7785442-a104-4157-a316-b20ff5033307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG os_vif [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09623b7b-4ccb-5b04-bacc-0e3818aa54ba', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb51dff57-d0, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb51dff57-d0, col_values=(('qos', UUID('0f6912a4-b595-4786-ab51-2987715a4707')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb51dff57-d0, col_values=(('external_ids', {'iface-id': 'b51dff57-d0f4-4a79-9ed9-88effe9cdfe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:2e:30', 'vm-uuid': 'd7785442-a104-4157-a316-b20ff5033307'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:34 user nova-compute[75206]: INFO os_vif [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0')
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:2c:2e:30, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:10:34 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:10:35 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=24.981861114501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d7785442-a104-4157-a316-b20ff5033307 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:10:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:10:36 user nova-compute[75206]: WARNING nova.compute.manager [req-72b456c3-b61c-48b1-a9a4-b6b3554b1dd8 req-7082acff-0d16-4f44-b725-7791305353f6 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state building and task_state spawning.
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:10:38 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d7785442-a104-4157-a316-b20ff5033307] Instance spawned successfully.
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.compute.manager [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:10:38 user nova-compute[75206]: WARNING nova.compute.manager [req-b84785d7-f4a7-4289-9f2e-f40d060692c5 req-f59d94ea-ba3e-4bc3-8b84-21b80f4e2478 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state building and task_state spawning.
Nov 29 22:10:38 user nova-compute[75206]: INFO nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 29 22:10:38 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:10:38 user nova-compute[75206]: INFO nova.compute.manager [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Took 19.21 seconds to build instance.
Nov 29 22:10:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ccca90ad-398e-4cb6-9bb1-6226e15cf8dd tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.302s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:39 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating instance_info_cache with network_info: [{"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:10:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-changed-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Refreshing instance network info cache due to event network-changed-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Refreshing network info cache for port 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:10:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updated VIF entry in instance network info cache for port 3ecc0b5c-70ba-4fb7-b6df-80784221d4b8. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:10:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:10:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0b456fef-62e5-4d94-bfe4-a4a3d5289efb req-dd8596a9-8fd4-4936-9b2e-01f9c8c4f3b4 service nova] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:10:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:50 user nova-compute[75206]: INFO nova.compute.manager [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Attaching volume c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 to /dev/vdb
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446c93a-7605-4d6c-9bae-f3cfa5b98fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35904a1-0e95-48cb-8eb7-46b2fe3e5fe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b81f1-2c75-4e62-b412-d77c8717ffa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86dcb28-e14f-45db-9fdf-32ec7f71e257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:10:50 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:10:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45320964-2a03-4be0-a08a-7091392db72b]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:10:50 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating existing volume attachment record: aabfed15-17e4-43ab-9eb6-505dc617165f {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:10:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:10:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:55 user nova-compute[75206]: INFO nova.compute.manager [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Detaching volume 39cefaa6-bfde-403a-87f5-903d91310a8f
Nov 29 22:10:55 user nova-compute[75206]: INFO nova.virt.block_device [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Attempting to driver detach volume 39cefaa6-bfde-403a-87f5-903d91310a8f from mountpoint /dev/vdb
Nov 29 22:10:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Attempting to detach device vdb from instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:10:55 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:10:55 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:10:55 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:10:55 user nova-compute[75206]:   <serial>39cefaa6-bfde-403a-87f5-903d91310a8f</serial>
Nov 29 22:10:55 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:10:55 user nova-compute[75206]: </disk>
Nov 29 22:10:55 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully detached device vdb from instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 from the persistent domain config.
Nov 29 22:10:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:10:55 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:10:55 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:10:55 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:10:55 user nova-compute[75206]:   <serial>39cefaa6-bfde-403a-87f5-903d91310a8f</serial>
Nov 29 22:10:55 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:10:55 user nova-compute[75206]: </disk>
Nov 29 22:10:55 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:10:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:10:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:58 user nova-compute[75206]: INFO nova.compute.manager [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Unshelving
Nov 29 22:10:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_requests' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:10:58 user nova-compute[75206]: INFO nova.compute.claims [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Claim successful on node user
Nov 29 22:10:58 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:10:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:10:58 user nova-compute[75206]: INFO nova.network.neutron [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating port fa4201bc-5635-4ca2-9ac8-abce9b965164 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:10:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:10:59 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe741b56-10c5-43c5-a50a-9f3a37cd1a5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:10:59 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c5175-b590-456e-b149-72ecd22975aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9] added
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a64af7-46b9-446b-b154-8c52835943c7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11311571-4d5c-447a-b66f-cb81d9e068c1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuTiNlft {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuTiNlft" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079bec4-03b1-499b-b987-e45c06172a5b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuTiNlft'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG nova.compute.manager [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing instance network info cache due to event network-changed-fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] Acquiring lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db85af-508d-430a-9579-103146d53459]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd227b4-7581-47ae-89a3-32862f599379]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da668bf-18c8-4067-a3af-dddabfaa0c50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]
Nov 29 22:10:59 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615aafb-c9c4-4ee2-8322-21068aa4dfd2]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[080db100-7676-460f-aa94-41da5674afbe]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:10:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5ca41-a4d9-4c7e-9ae3-3c16a4f5d0fb]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:10:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG nova.network.neutron [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:11:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Creating image(s)
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] Acquired lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG nova.network.neutron [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Refreshing network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG nova.objects.base [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<2bf4b75b-e4fe-449a-93b0-4f5dc64228d3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "cbebf6538616e4ac57801d1774e8238df0117111" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "cbebf6538616e4ac57801d1774e8238df0117111" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.part --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.874s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== connect_volume: return (1877ms) {'type': 'block', 'scsi_wwn': '26266303061393531', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266303061393531', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.objects.instance [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:11:01 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:11:01 user nova-compute[75206]:   <source dev="/dev/sdd"/>
Nov 29 22:11:01 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:11:01 user nova-compute[75206]:   <serial>c4fb6902-edab-4cf0-91b9-e20b35c5fdf9</serial>
Nov 29 22:11:01 user nova-compute[75206]: </disk>
Nov 29 22:11:01 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.images [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] 36150ae6-89dd-4267-a780-37cdcb58d42c was qcow2, converting to raw {{(pid=75206) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.privsep.utils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75206) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.part /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.converted {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updated VIF entry in instance network info cache for port fa4201bc-5635-4ca2-9ac8-abce9b965164. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6c7063de-d0d3-49af-b99a-2136456767a2 req-4ed3b20b-e412-49b3-b78f-b49e14b0d624 service nova] Releasing lock "refresh_cache-2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No VIF found with MAC fa:16:3e:81:11:2f, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-05cce803-adc4-44c9-b58e-657f399784e2 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.828s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:01 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.part /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.converted" returned: 0 in 0.745s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.converted --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "cbebf6538616e4ac57801d1774e8238df0117111" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.138s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "cbebf6538616e4ac57801d1774e8238df0117111" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "cbebf6538616e4ac57801d1774e8238df0117111" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111,backing_fmt=raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111,backing_fmt=raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk 1073741824" returned: 0 in 0.078s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "cbebf6538616e4ac57801d1774e8238df0117111" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.compute.manager [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:02 user nova-compute[75206]: WARNING nova.compute.manager [req-733d46b1-73dc-4068-9bcd-398c9592ef1f req-c57f0e46-742b-42a5-af9a-c95302ffb999 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state active and task_state powering-off.
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'migration_context' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:02 user nova-compute[75206]: DEBUG nova.objects.base [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<2bf4b75b-e4fe-449a-93b0-4f5dc64228d3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:11:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Rebasing disk image.
Nov 29 22:11:02 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 -F raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance destroyed successfully.
Nov 29 22:11:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:11:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8514c5c5-62ed-46a6-905b-ce69286077ba tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.889s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:04 user nova-compute[75206]: DEBUG nova.compute.manager [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:04 user nova-compute[75206]: WARNING nova.compute.manager [req-c2c81d3f-083c-4744-83ea-32fc626caf2a req-eb9294c2-c7ad-4e08-8685-c7dc101670ea service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:11:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 -F raw /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk" returned: 0 in 2.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start _get_guest_xml network_info=[{"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d4ba5a98815d84a83fc769cc18a66643',container_format='bare',created_at=2023-11-29T22:09:06Z,direct_url=<?>,disk_format='qcow2',id=36150ae6-89dd-4267-a780-37cdcb58d42c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-705980213-shelved',owner='0fefc9dd69d944df892990a9db00c4e8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T22:09:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:11:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:11:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d4ba5a98815d84a83fc769cc18a66643',container_format='bare',created_at=2023-11-29T22:09:06Z,direct_url=<?>,disk_format='qcow2',id=36150ae6-89dd-4267-a780-37cdcb58d42c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-705980213-shelved',owner='0fefc9dd69d944df892990a9db00c4e8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T22:09:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.objects.base [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<2bf4b75b-e4fe-449a-93b0-4f5dc64228d3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='36150ae6-89dd-4267-a780-37cdcb58d42c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-317493109',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:07:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:09:10.334454',shelved_host='user',shelved_image_id='36150ae6-89dd-4267-a780-37cdcb58d42c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.objects.base [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Object Instance<2bf4b75b-e4fe-449a-93b0-4f5dc64228d3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:11:05 user nova-compute[75206]:   <uuid>2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</uuid>
Nov 29 22:11:05 user nova-compute[75206]:   <name>instance-0000002a</name>
Nov 29 22:11:05 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:11:05 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:11:05 user nova-compute[75206]:   <metadata>
Nov 29 22:11:05 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:11:05 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-705980213</nova:name>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:11:05</nova:creationTime>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:11:05 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:11:05 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:owner>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:user uuid="e7d06116d600497090ba07fcb86ee782">tempest-AttachVolumeShelveTestJSON-700434495-project-member</nova:user>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:project uuid="0fefc9dd69d944df892990a9db00c4e8">tempest-AttachVolumeShelveTestJSON-700434495</nova:project>
Nov 29 22:11:05 user nova-compute[75206]:       </nova:owner>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:root type="image" uuid="36150ae6-89dd-4267-a780-37cdcb58d42c"/>
Nov 29 22:11:05 user nova-compute[75206]:       <nova:ports>
Nov 29 22:11:05 user nova-compute[75206]:         <nova:port uuid="fa4201bc-5635-4ca2-9ac8-abce9b965164">
Nov 29 22:11:05 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 22:11:05 user nova-compute[75206]:         </nova:port>
Nov 29 22:11:05 user nova-compute[75206]:       </nova:ports>
Nov 29 22:11:05 user nova-compute[75206]:     </nova:instance>
Nov 29 22:11:05 user nova-compute[75206]:   </metadata>
Nov 29 22:11:05 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:11:05 user nova-compute[75206]:     <system>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="serial">2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</entry>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="uuid">2bf4b75b-e4fe-449a-93b0-4f5dc64228d3</entry>
Nov 29 22:11:05 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:11:05 user nova-compute[75206]:     </system>
Nov 29 22:11:05 user nova-compute[75206]:   </sysinfo>
Nov 29 22:11:05 user nova-compute[75206]:   <os>
Nov 29 22:11:05 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:11:05 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:11:05 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:11:05 user nova-compute[75206]:   </os>
Nov 29 22:11:05 user nova-compute[75206]:   <features>
Nov 29 22:11:05 user nova-compute[75206]:     <acpi/>
Nov 29 22:11:05 user nova-compute[75206]:     <apic/>
Nov 29 22:11:05 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:11:05 user nova-compute[75206]:   </features>
Nov 29 22:11:05 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:11:05 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:11:05 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:11:05 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:11:05 user nova-compute[75206]:   </clock>
Nov 29 22:11:05 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:11:05 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:11:05 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:11:05 user nova-compute[75206]:   </cpu>
Nov 29 22:11:05 user nova-compute[75206]:   <devices>
Nov 29 22:11:05 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:11:05 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:11:05 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk"/>
Nov 29 22:11:05 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:11:05 user nova-compute[75206]:     </disk>
Nov 29 22:11:05 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:11:05 user nova-compute[75206]:       <mac address="fa:16:3e:9f:0a:13"/>
Nov 29 22:11:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:11:05 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:11:05 user nova-compute[75206]:       <target dev="tapfa4201bc-56"/>
Nov 29 22:11:05 user nova-compute[75206]:     </interface>
Nov 29 22:11:05 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:11:05 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/console.log" append="off"/>
Nov 29 22:11:05 user nova-compute[75206]:     </serial>
Nov 29 22:11:05 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:11:05 user nova-compute[75206]:     <video>
Nov 29 22:11:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:11:05 user nova-compute[75206]:     </video>
Nov 29 22:11:05 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:11:05 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:11:05 user nova-compute[75206]:     </rng>
Nov 29 22:11:05 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:11:05 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:11:05 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:11:05 user nova-compute[75206]:     </memballoon>
Nov 29 22:11:05 user nova-compute[75206]:   </devices>
Nov 29 22:11:05 user nova-compute[75206]: </domain>
Nov 29 22:11:05 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='36150ae6-89dd-4267-a780-37cdcb58d42c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-317493109',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:07:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member',shelved_at='2023-11-29T22:09:10.334454',shelved_host='user',shelved_image_id='36150ae6-89dd-4267-a780-37cdcb58d42c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG os_vif [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dbe4d46-cb53-5e7d-8e93-fdfe616c16b5', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4201bc-56, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4201bc-56, col_values=(('qos', UUID('adc2dc75-0311-47f0-8ac8-3945bd94acd8')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4201bc-56, col_values=(('external_ids', {'iface-id': 'fa4201bc-5635-4ca2-9ac8-abce9b965164', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:0a:13', 'vm-uuid': '2bf4b75b-e4fe-449a-93b0-4f5dc64228d3'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:05 user nova-compute[75206]: INFO os_vif [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56')
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:11:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] No VIF found with MAC fa:16:3e:9f:0a:13, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:11:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:07 user nova-compute[75206]: WARNING nova.compute.manager [req-8c239d1e-c542-4bee-a0a7-1ccbafae7fe2 req-b21e5613-cc35-4786-976f-a5d02839d95f service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:11:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:11:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance spawned successfully.
Nov 29 22:11:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:09 user nova-compute[75206]: WARNING nova.compute.manager [req-e50c2640-2a29-4bae-b2b6-8e7783b931ae req-d0e4aca0-e64a-4c59-b8ca-61d187384b31 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 22:11:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:11:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-be75146f-9f16-4339-b661-3612de6b04bf tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.292s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:15 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 is timed out.
Nov 29 22:11:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully detached device vdb from instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 from the live domain config.
Nov 29 22:11:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGJKfzqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:11:15 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ad86f-5949-419e-a247-98e2edddaabe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:11:15 user nova-compute[75206]: No targets found.
Nov 29 22:11:15 user nova-compute[75206]: iSNS:
Nov 29 22:11:15 user nova-compute[75206]: No targets found.
Nov 29 22:11:15 user nova-compute[75206]: STATIC:
Nov 29 22:11:15 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:11:15 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:11:15 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:11:15 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f
Nov 29 22:11:15 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:11:15 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:11:15 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819
Nov 29 22:11:15 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:11:15 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:11:15 user nova-compute[75206]: FIRMWARE:
Nov 29 22:11:15 user nova-compute[75206]: No targets found.
Nov 29 22:11:15 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:11:15 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:11:15 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:11:15 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0767a-573f-4542-b6b9-d177d438e0d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2eb826-52f4-4b8b-bc2f-de040edceb14]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:11:16 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:11:16 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:11:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f (non-flash)
Nov 29 22:11:16 user nova-compute[75206]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:11:16 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:11:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c836a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc2f7e-a2f6-4eb6-b212-d370af4350e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c51360-f4c5-40e3-9872-5b2735adcaf0]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd744d1-7aa8-4fcb-99af-0a3fe6f88e42]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7249a3-217f-4248-a215-ec73ca33ce69]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31636e28-8f0a-4a92-a1d8-2d18ec34a77e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87648b3-77fe-4138-87b5-16857d891d21]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260]
Nov 29 22:11:16 user nova-compute[75206]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f, portal: 172.16.0.220,3260] successful.
Nov 29 22:11:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f14e79-ae8f-4b1b-84bb-320e5caddfd7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] <== disconnect_volume: return (304ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:11:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.objects.instance [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'flavor' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-4e5abc40-6f13-4926-b4fd-62bd54bcf4db tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.657s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:17 user nova-compute[75206]: INFO nova.compute.manager [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Terminating instance
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-unplugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] No waiting events found dispatching network-vif-unplugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-90452721-aa77-475b-9783-90057b28dc90 req-e4223d46-b112-4f15-ba71-756ce34a030e service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-unplugged-8f83c007-b4fd-4cd1-8f90-21421dca750d for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Instance destroyed successfully.
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lazy-loading 'resources' on Instance uuid e4efeeb0-4ebb-4c85-be3f-0aef586d9a12 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1289691179',display_name='tempest-VolumesSnapshotTestJSON-instance-1289691179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1289691179',id=43,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqCoTB6bw5cGttr7e4A9Go3VhXu38/VM3P6ochPg1FIQBmwjnv+pmJzA7NnCvQSF2GjxmHIjtRBb8uEuRjj0s1FAkArZiZVfSRrtji7p+qg/2UBt7jHfLt4g20bdsaxeQ==',key_name='tempest-keypair-1663481186',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97782e20f03429793d463cae864c17f',ramdisk_id='',reservation_id='r-et850ahr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1635594989',owner_user_name='tempest-VolumesSnapshotTestJSON-1635594989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd4014bdbbf4434ab64a764f95c5767',uuid=e4efeeb0-4ebb-4c85-be3f-0aef586d9a12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converting VIF {"id": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "address": "fa:16:3e:07:a2:85", "network": {"id": "3015655e-f434-4cf5-b4b3-5426f70b2700", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-384160131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c97782e20f03429793d463cae864c17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f83c007-b4", "ovs_interfaceid": "8f83c007-b4fd-4cd1-8f90-21421dca750d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG os_vif [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f83c007-b4, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=459435c5-f12c-4425-9766-948dfabd07eb) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:18 user nova-compute[75206]: INFO os_vif [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a2:85,bridge_name='br-int',has_traffic_filtering=True,id=8f83c007-b4fd-4cd1-8f90-21421dca750d,network=Network(3015655e-f434-4cf5-b4b3-5426f70b2700),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f83c007-b4')
Nov 29 22:11:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGJKfzqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:11:18 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[762181a8-bdb6-4910-bdab-f724087631c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:11:18 user nova-compute[75206]: No targets found.
Nov 29 22:11:18 user nova-compute[75206]: iSNS:
Nov 29 22:11:18 user nova-compute[75206]: No targets found.
Nov 29 22:11:18 user nova-compute[75206]: STATIC:
Nov 29 22:11:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:11:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:11:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:11:18 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819
Nov 29 22:11:18 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:11:18 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:11:18 user nova-compute[75206]: FIRMWARE:
Nov 29 22:11:18 user nova-compute[75206]: No targets found.
Nov 29 22:11:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:11:18 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:11:18 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39cefaa6-bfde-403a-87f5-903d91310a8f', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72a425-5f1e-46d6-a75f-e1dc463be1c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fe2fd-8097-446d-9717-93861d761373]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:11:18 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:11:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:11:18 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:11:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8467b50>, {}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Disconnecting from: [] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] <== disconnect_volume: return (70ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:11:18 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Deleting instance files /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12_del
Nov 29 22:11:18 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Deletion of /opt/stack/data/nova/instances/e4efeeb0-4ebb-4c85-be3f-0aef586d9a12_del complete
Nov 29 22:11:18 user nova-compute[75206]: INFO nova.compute.manager [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 22:11:18 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:11:18 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:11:19 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Took 0.87 seconds to deallocate network for instance.
Nov 29 22:11:19 user nova-compute[75206]: WARNING nova.volume.cinder [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Attachment 6e65cb83-1f95-4d5c-a3e8-57522ae8cc34 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6e65cb83-1f95-4d5c-a3e8-57522ae8cc34. (HTTP 404) (Request-ID: req-872475fc-50eb-4e3a-b616-daf569897e5b)
Nov 29 22:11:19 user nova-compute[75206]: INFO nova.compute.manager [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:19 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Deleted allocations for instance e4efeeb0-4ebb-4c85-be3f-0aef586d9a12
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e4127114-09a4-478e-9ecb-326cb7efc4aa tempest-VolumesSnapshotTestJSON-1635594989 tempest-VolumesSnapshotTestJSON-1635594989-project-member] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] Acquiring lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] Lock "e4efeeb0-4ebb-4c85-be3f-0aef586d9a12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] No waiting events found dispatching network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:11:19 user nova-compute[75206]: WARNING nova.compute.manager [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received unexpected event network-vif-plugged-8f83c007-b4fd-4cd1-8f90-21421dca750d for instance with vm_state deleted and task_state None.
Nov 29 22:11:19 user nova-compute[75206]: DEBUG nova.compute.manager [req-18800adf-57b6-4a33-a12c-c56892d0b606 req-1d5f4ec7-11e6-4279-ba65-509ac58ae720 service nova] [instance: e4efeeb0-4ebb-4c85-be3f-0aef586d9a12] Received event network-vif-deleted-8f83c007-b4fd-4cd1-8f90-21421dca750d {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:11:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:11:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:11:37 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:11:37 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=24.972007751464844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance d7785442-a104-4157-a316-b20ff5033307 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:11:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:11:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:11:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:11:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:11:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:11:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:11:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:11:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:11:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid d7785442-a104-4157-a316-b20ff5033307 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d7785442-a104-4157-a316-b20ff5033307" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "d7785442-a104-4157-a316-b20ff5033307" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:10 user nova-compute[75206]: INFO nova.compute.manager [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Terminating instance
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-66a539d7-877b-47b1-b13a-6004daf87666 req-07eba95d-37b6-4c1a-b988-b135cc847746 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: d7785442-a104-4157-a316-b20ff5033307] Instance destroyed successfully.
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid d7785442-a104-4157-a316-b20ff5033307 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:10:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1665438073',display_name='tempest-TestVolumeBootPattern-server-1665438073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1665438073',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-keo0hmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:10:38Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=d7785442-a104-4157-a316-b20ff5033307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "address": "fa:16:3e:2c:2e:30", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51dff57-d0", "ovs_interfaceid": "b51dff57-d0f4-4a79-9ed9-88effe9cdfe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_vif [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb51dff57-d0, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f6912a4-b595-4786-ab51-2987715a4707) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:10 user nova-compute[75206]: INFO os_vif [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:2e:30,bridge_name='br-int',has_traffic_filtering=True,id=b51dff57-d0f4-4a79-9ed9-88effe9cdfe4,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51dff57-d0')
Nov 29 22:12:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFKyvCgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:12:10 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb844087-7822-4639-a542-32d8bdc22e27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:12:10 user nova-compute[75206]: No targets found.
Nov 29 22:12:10 user nova-compute[75206]: iSNS:
Nov 29 22:12:10 user nova-compute[75206]: No targets found.
Nov 29 22:12:10 user nova-compute[75206]: STATIC:
Nov 29 22:12:10 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:12:10 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:12:10 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:12:10 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819
Nov 29 22:12:10 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:12:10 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:12:10 user nova-compute[75206]: FIRMWARE:
Nov 29 22:12:10 user nova-compute[75206]: No targets found.
Nov 29 22:12:10 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:12:10 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:12:10 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e04b9-d5bf-48e7-9360-6f7074b4b009]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d228e4-6b14-431b-b079-df8311c3b644]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:12:11 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 (non-flash)
Nov 29 22:12:11 user nova-compute[75206]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c806fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bcf5b7-f456-4e0b-8f6c-db6c6a5bbf29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[027e4d1a-e1a2-45d5-b3fa-7fff25272dbb]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a9724c-5893-4bb6-8fbb-dc93ac2962eb]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11176997-1727-4a2f-872f-c52e9a88eedc]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[171438ec-afa9-49c7-8383-c8198b81efbd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f56bcf-12ee-4dfd-ae62-876dc6919eb0]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260]
Nov 29 22:12:11 user nova-compute[75206]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819, portal: 172.16.0.220,3260] successful.
Nov 29 22:12:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1b0b5d-8f61-4038-a5e2-54d5373ed819 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b81e57c-3eb7-489d-a955-fe85b01cabf3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (315ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:12:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Deleting instance files /opt/stack/data/nova/instances/d7785442-a104-4157-a316-b20ff5033307_del
Nov 29 22:12:11 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Deletion of /opt/stack/data/nova/instances/d7785442-a104-4157-a316-b20ff5033307_del complete
Nov 29 22:12:11 user nova-compute[75206]: INFO nova.compute.manager [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 22:12:11 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: d7785442-a104-4157-a316-b20ff5033307] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d7785442-a104-4157-a316-b20ff5033307] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:11 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: d7785442-a104-4157-a316-b20ff5033307] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:12:11 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: d7785442-a104-4157-a316-b20ff5033307] Took 0.59 seconds to deallocate network for instance.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:12 user nova-compute[75206]: WARNING nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state active and task_state deleting.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:12 user nova-compute[75206]: WARNING nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state active and task_state deleting.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:12 user nova-compute[75206]: WARNING nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state active and task_state deleting.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-unplugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Acquiring lock "d7785442-a104-4157-a316-b20ff5033307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] Lock "d7785442-a104-4157-a316-b20ff5033307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] No waiting events found dispatching network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:12 user nova-compute[75206]: WARNING nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received unexpected event network-vif-plugged-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 for instance with vm_state active and task_state deleting.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [req-0550678f-e374-4927-9bd0-fce7f9880138 req-f3270f51-29fd-4a45-9fd5-e890ba367a57 service nova] [instance: d7785442-a104-4157-a316-b20ff5033307] Received event network-vif-deleted-b51dff57-d0f4-4a79-9ed9-88effe9cdfe4 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:12 user nova-compute[75206]: INFO nova.compute.manager [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Took 0.84 seconds to detach 1 volumes for instance.
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: d7785442-a104-4157-a316-b20ff5033307] Deleting volume: 9d1b0b5d-8f61-4038-a5e2-54d5373ed819 {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:12:12 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:12:13 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:12:13 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:12:13 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:12:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:13 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance d7785442-a104-4157-a316-b20ff5033307
Nov 29 22:12:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9b56b9dc-041d-492f-9336-e819b3e8c449 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "d7785442-a104-4157-a316-b20ff5033307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.186s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:38 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:12:39 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:12:39 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=24.961631774902344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:12:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:12:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:12:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:48 user nova-compute[75206]: INFO nova.compute.manager [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Terminating instance
Nov 29 22:12:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-3380bfa2-d799-4cde-aea6-9ed2836a00fe req-57b123b8-7ae2-4849-b5a1-3759dc4d4ed0 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-unplugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Instance destroyed successfully.
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lazy-loading 'resources' on Instance uuid 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T22:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-705980213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-705980213',id=42,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjzx+aQp9485SU7v0Rf0fbQCIGbSdklzCu9WZwk/1ePybHZ0NZYo4ht9w+hEvJ5NGnunAOnMefsHXiBTf8BM9YDcv1viAn4kNwbNaznCKFiYNo+30bq4mhHphrCbaeAPA==',key_name='tempest-keypair-317493109',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fefc9dd69d944df892990a9db00c4e8',ramdisk_id='',reservation_id='r-l6rk04pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-700434495',owner_user_name='tempest-AttachVolumeShelveTestJSON-700434495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7d06116d600497090ba07fcb86ee782',uuid=2bf4b75b-e4fe-449a-93b0-4f5dc64228d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converting VIF {"id": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "address": "fa:16:3e:9f:0a:13", "network": {"id": "4ca73bc4-a5de-4d96-ac30-00b0378a84c6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1339598842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fefc9dd69d944df892990a9db00c4e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4201bc-56", "ovs_interfaceid": "fa4201bc-5635-4ca2-9ac8-abce9b965164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG os_vif [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4201bc-56, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adc2dc75-0311-47f0-8ac8-3945bd94acd8) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:49 user nova-compute[75206]: INFO os_vif [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0a:13,bridge_name='br-int',has_traffic_filtering=True,id=fa4201bc-5635-4ca2-9ac8-abce9b965164,network=Network(4ca73bc4-a5de-4d96-ac30-00b0378a84c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4201bc-56')
Nov 29 22:12:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Deleting instance files /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3_del
Nov 29 22:12:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Deletion of /opt/stack/data/nova/instances/2bf4b75b-e4fe-449a-93b0-4f5dc64228d3_del complete
Nov 29 22:12:49 user nova-compute[75206]: INFO nova.compute.manager [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 22:12:49 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:12:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:12:50 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Took 0.95 seconds to deallocate network for instance.
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:50 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Deleted allocations for instance 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-8b28eb7c-6161-4c91-ab50-84273429b40b tempest-AttachVolumeShelveTestJSON-700434495 tempest-AttachVolumeShelveTestJSON-700434495-project-member] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] Acquiring lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] Lock "2bf4b75b-e4fe-449a-93b0-4f5dc64228d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] No waiting events found dispatching network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:50 user nova-compute[75206]: WARNING nova.compute.manager [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received unexpected event network-vif-plugged-fa4201bc-5635-4ca2-9ac8-abce9b965164 for instance with vm_state deleted and task_state None.
Nov 29 22:12:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-f6524346-bdbb-470a-aa38-5658cebf1fa2 req-0bc64de9-590d-49ad-875e-e3f37013cb64 service nova] [instance: 2bf4b75b-e4fe-449a-93b0-4f5dc64228d3] Received event network-vif-deleted-fa4201bc-5635-4ca2-9ac8-abce9b965164 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:12:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'info_cache' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:53 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:12:54 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance destroyed successfully.
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'resources' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ecc0b5c-70, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7de736ee-9ed6-4afd-b2b8-191c4a7173ba) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:54 user nova-compute[75206]: INFO os_vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:12:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c046ea6-09d1-4aca-a33c-1de4f1eb3d29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:12:54 user nova-compute[75206]: No targets found.
Nov 29 22:12:54 user nova-compute[75206]: iSNS:
Nov 29 22:12:54 user nova-compute[75206]: No targets found.
Nov 29 22:12:54 user nova-compute[75206]: STATIC:
Nov 29 22:12:54 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:12:54 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:12:54 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:12:54 user nova-compute[75206]: FIRMWARE:
Nov 29 22:12:54 user nova-compute[75206]: No targets found.
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:12:54 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:12:54 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78039c0-fdac-4c9d-96ea-e2c053d02498]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a631ebf-d5a5-47cc-a16e-99e34e1172c6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8279870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb791be5-543c-4b70-896d-da3566e801f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57db52e-abad-4d83-bc17-c4d8ca078fb4]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef843ae-4698-44f6-a770-ecdba69f3a0e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[996250a5-7077-425c-bff5-f49246eb5b66]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4a4d06-8bf3-4cec-860e-d961877ca548]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0053be-ba6e-4afd-9bf4-f33158f24ad2]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]
Nov 29 22:12:54 user nova-compute[75206]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee326f66-5b06-475f-a808-6d8e3207d332]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== disconnect_volume: return (290ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start _get_guest_xml network_info=[{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'aabfed15-17e4-43ab-9eb6-505dc617165f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b46c8fed-be56-42ef-9eae-cc3a08cc3ac4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'serial': 'c4fb6902-edab-4cf0-91b9-e20b35c5fdf9'}, 'disk_bus': 'virtio', 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'numa_topology' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:54 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:12:54 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'vcpu_model' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:12:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:12:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:12:54 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25324fec-2eb3-43bb-943a-fbc3cdf3e73c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:12:54 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2140be73-4d9b-46c3-aa6b-98358842b1c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9] added
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[90969676-1975-4369-81f1-80c0218ddcd3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f00be-037c-4b17-890a-b9538ca9add7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuTiNlft {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuTiNlft" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fdee0-f898-46b7-bbdc-70c9d9777a87]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuTiNlft'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11680bcb-67fd-4fba-bf7e-fddc6777eb72]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350684b-7a2f-4511-9c51-8df77a875d26]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:12:54 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:12:54 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:12:54 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 22:12:54 user nova-compute[75206]: 
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b3875-5a58-40e2-8028-ededef55ed2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]
Nov 29 22:12:54 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb187fa-b276-4b84-8597-0742d18d734e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3df6ff-d56d-4c02-aeaa-a441e81806d2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:12:54 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbcd343-e7f5-478a-9a81-7b5c31f77742]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:12:54 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26266303061393531', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266303061393531', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'pci_devices' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:12:55 user nova-compute[75206]:   <uuid>b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</uuid>
Nov 29 22:12:55 user nova-compute[75206]:   <name>instance-0000002c</name>
Nov 29 22:12:55 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:12:55 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:12:55 user nova-compute[75206]:   <metadata>
Nov 29 22:12:55 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:12:55 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeTestJSON-server-904787670</nova:name>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:12:54</nova:creationTime>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:12:55 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:12:55 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:owner>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:user uuid="fec00476dc9c48e589ba6105b5b5cf7c">tempest-AttachVolumeTestJSON-1138208547-project-member</nova:user>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:project uuid="4edbbd3bc5d74985817fc88839c58e4f">tempest-AttachVolumeTestJSON-1138208547</nova:project>
Nov 29 22:12:55 user nova-compute[75206]:       </nova:owner>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:12:55 user nova-compute[75206]:       <nova:ports>
Nov 29 22:12:55 user nova-compute[75206]:         <nova:port uuid="3ecc0b5c-70ba-4fb7-b6df-80784221d4b8">
Nov 29 22:12:55 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 22:12:55 user nova-compute[75206]:         </nova:port>
Nov 29 22:12:55 user nova-compute[75206]:       </nova:ports>
Nov 29 22:12:55 user nova-compute[75206]:     </nova:instance>
Nov 29 22:12:55 user nova-compute[75206]:   </metadata>
Nov 29 22:12:55 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:12:55 user nova-compute[75206]:     <system>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="serial">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="uuid">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:12:55 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:12:55 user nova-compute[75206]:     </system>
Nov 29 22:12:55 user nova-compute[75206]:   </sysinfo>
Nov 29 22:12:55 user nova-compute[75206]:   <os>
Nov 29 22:12:55 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:12:55 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:12:55 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:12:55 user nova-compute[75206]:   </os>
Nov 29 22:12:55 user nova-compute[75206]:   <features>
Nov 29 22:12:55 user nova-compute[75206]:     <acpi/>
Nov 29 22:12:55 user nova-compute[75206]:     <apic/>
Nov 29 22:12:55 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:12:55 user nova-compute[75206]:   </features>
Nov 29 22:12:55 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:12:55 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:12:55 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:12:55 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:12:55 user nova-compute[75206]:   </clock>
Nov 29 22:12:55 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:12:55 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:12:55 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:12:55 user nova-compute[75206]:   </cpu>
Nov 29 22:12:55 user nova-compute[75206]:   <devices>
Nov 29 22:12:55 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:12:55 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:12:55 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk"/>
Nov 29 22:12:55 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:12:55 user nova-compute[75206]:     </disk>
Nov 29 22:12:55 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:12:55 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:12:55 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 22:12:55 user nova-compute[75206]:       <target dev="vdb" bus="virtio"/>
Nov 29 22:12:55 user nova-compute[75206]:       <serial>c4fb6902-edab-4cf0-91b9-e20b35c5fdf9</serial>
Nov 29 22:12:55 user nova-compute[75206]:     </disk>
Nov 29 22:12:55 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:12:55 user nova-compute[75206]:       <mac address="fa:16:3e:81:11:2f"/>
Nov 29 22:12:55 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:12:55 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:12:55 user nova-compute[75206]:       <target dev="tap3ecc0b5c-70"/>
Nov 29 22:12:55 user nova-compute[75206]:     </interface>
Nov 29 22:12:55 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:12:55 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/console.log" append="off"/>
Nov 29 22:12:55 user nova-compute[75206]:     </serial>
Nov 29 22:12:55 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:12:55 user nova-compute[75206]:     <video>
Nov 29 22:12:55 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:12:55 user nova-compute[75206]:     </video>
Nov 29 22:12:55 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:12:55 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:12:55 user nova-compute[75206]:     </rng>
Nov 29 22:12:55 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:12:55 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:12:55 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:12:55 user nova-compute[75206]:     </memballoon>
Nov 29 22:12:55 user nova-compute[75206]:   </devices>
Nov 29 22:12:55 user nova-compute[75206]: </domain>
Nov 29 22:12:55 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:12:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'trusted_certs' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.169s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Cannot resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.objects.instance [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'migration_context' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.objects.base [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG os_vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '954b17b0-64a4-59c6-bc0c-7475cbeb9ae9', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ecc0b5c-70, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ecc0b5c-70, col_values=(('qos', UUID('273529d6-ea64-4115-91f3-d4a34fd856b4')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ecc0b5c-70, col_values=(('external_ids', {'iface-id': '3ecc0b5c-70ba-4fb7-b6df-80784221d4b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:11:2f', 'vm-uuid': 'b46c8fed-be56-42ef-9eae-cc3a08cc3ac4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:12:56 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:56 user nova-compute[75206]: INFO os_vif [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:12:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG nova.compute.manager [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:12:58 user nova-compute[75206]: WARNING nova.compute.manager [req-46e84bd1-c2ae-43c2-aeb8-58e85ba5b4a8 req-5263a6b3-718d-4b4d-ac1b-b06e39e97196 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state powering-on.
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:12:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:13:00 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance rebooted successfully.
Nov 29 22:13:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-c9877441-1849-4220-b602-031a81e2ef9b tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:00 user nova-compute[75206]: DEBUG nova.compute.manager [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:13:00 user nova-compute[75206]: WARNING nova.compute.manager [req-cde2a742-6585-41bb-a3fb-74e8d176813c req-490838c8-d278-4520-b21b-fcf9044325d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state active and task_state None.
Nov 29 22:13:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:11 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:13:16 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:13:23 user nova-compute[75206]: INFO nova.compute.claims [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Claim successful on node user
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:13:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG nova.policy [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:13:23 user nova-compute[75206]: INFO nova.virt.block_device [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Booting with volume b250ff38-6e1c-4d9e-870a-31c4e194b2f0 at /dev/vda
Nov 29 22:13:23 user nova-compute[75206]: DEBUG os_brick.utils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[646261e3-85e9-4a69-97fd-ac85f71c598e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf6c524-9994-42cd-a3bd-d0af8675b3fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2d6db8-bf53-4760-ab7c-e381aa01ea62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e44e1c-bb4f-40be-ba11-ca682ff057c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:23 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:13:24 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:13:24 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b2327-4529-4533-a13d-7dcb8378c551]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG os_brick.utils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating existing volume attachment record: 6480d47b-36f6-4545-9fa8-d6c30d1416a7 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Successfully created port: dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Successfully updated port: dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-changed-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.compute.manager [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Refreshing instance network info cache due to event network-changed-dba2f7b8-4a0c-487f-a583-654187224a82. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] Acquiring lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Instance network_info: |[{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] Acquired lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Refreshing network info cache for port dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updated VIF entry in instance network info cache for port dba2f7b8-4a0c-487f-a583-654187224a82. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:13:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-be94d046-fcc2-4a67-ad57-61ab206a46a1 req-34741f3c-fe93-49ed-8656-86f5495905f4 service nova] Releasing lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:13:26 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:13:31 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Creating image(s)
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Ensure instance console log exists: /opt/stack/data/nova/instances/3b80ec76-d54a-4144-90b5-c346321357e3/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Start _get_guest_xml network_info=[{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '6480d47b-36f6-4545-9fa8-d6c30d1416a7', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPqKUgwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b80ec76-d54a-4144-90b5-c346321357e3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 'serial': 'b250ff38-6e1c-4d9e-870a-31c4e194b2f0'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:13:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:13:31 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPqKUgwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:13:31 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:13:31 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:13:31 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ce93e-90d6-4bfb-b967-30281c94f78a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:13:31 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a5b5f-7c41-443e-9ee9-e7acc56429f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0] added
Nov 29 22:13:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a7648-ef86-401c-a4dd-e17e896f6428]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7eef13-2048-4911-aa3a-e95b8e974465]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPqKUgwr {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPqKUgwr" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947fb39-9c26-4253-bb92-281bfc9d6bb3]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPqKUgwr'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ecdfc3-7c7b-45ca-9000-3b593f68c8c1]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482efc0-d0af-46f5-bc04-b470107b942c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:13:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:13:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:13:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b4347-97a8-426d-87e1-6e7d9e84b18e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260]
Nov 29 22:13:32 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260] successful.
Nov 29 22:13:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087587c-af12-4da1-a1f4-0995b5720bde]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[232fc114-b7e7-4745-9cce-e9dbdf11e94a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:13:32 user nova-compute[75206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:13:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:13:32 user nova-compute[75206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:13:32 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec4b40-71f7-46c9-b26c-dc506500d032]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPqKUgwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:13:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23736353334623032', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736353334623032', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1118128040',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoaIt3Mnc58Vt9jIxjRE96OCvO0FOVqdA5dRRRIl26HYhpLO31XKrdml1+hLr9kOS4zFr+hagH9ku7MozBMHAo2/+P68Hj+uWowCqC7pZxbx9MU1LOwdxe+BOVwddy1kw==',key_name='tempest-keypair-1320551098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-fjpd8jgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=3b80ec76-d54a-4144-90b5-c346321357e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.objects.instance [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b80ec76-d54a-4144-90b5-c346321357e3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:13:33 user nova-compute[75206]:   <uuid>3b80ec76-d54a-4144-90b5-c346321357e3</uuid>
Nov 29 22:13:33 user nova-compute[75206]:   <name>instance-0000002e</name>
Nov 29 22:13:33 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:13:33 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:13:33 user nova-compute[75206]:   <metadata>
Nov 29 22:13:33 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:13:33 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:13:33 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1118128040</nova:name>
Nov 29 22:13:33 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:13:31</nova:creationTime>
Nov 29 22:13:33 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:13:33 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:13:33 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:13:33 user nova-compute[75206]:       <nova:owner>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:13:33 user nova-compute[75206]:       </nova:owner>
Nov 29 22:13:33 user nova-compute[75206]:       <nova:ports>
Nov 29 22:13:33 user nova-compute[75206]:         <nova:port uuid="dba2f7b8-4a0c-487f-a583-654187224a82">
Nov 29 22:13:33 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 22:13:33 user nova-compute[75206]:         </nova:port>
Nov 29 22:13:33 user nova-compute[75206]:       </nova:ports>
Nov 29 22:13:33 user nova-compute[75206]:     </nova:instance>
Nov 29 22:13:33 user nova-compute[75206]:   </metadata>
Nov 29 22:13:33 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:13:33 user nova-compute[75206]:     <system>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="serial">3b80ec76-d54a-4144-90b5-c346321357e3</entry>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="uuid">3b80ec76-d54a-4144-90b5-c346321357e3</entry>
Nov 29 22:13:33 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:13:33 user nova-compute[75206]:     </system>
Nov 29 22:13:33 user nova-compute[75206]:   </sysinfo>
Nov 29 22:13:33 user nova-compute[75206]:   <os>
Nov 29 22:13:33 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:13:33 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:13:33 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:13:33 user nova-compute[75206]:   </os>
Nov 29 22:13:33 user nova-compute[75206]:   <features>
Nov 29 22:13:33 user nova-compute[75206]:     <acpi/>
Nov 29 22:13:33 user nova-compute[75206]:     <apic/>
Nov 29 22:13:33 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:13:33 user nova-compute[75206]:   </features>
Nov 29 22:13:33 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:13:33 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:13:33 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:13:33 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:13:33 user nova-compute[75206]:   </clock>
Nov 29 22:13:33 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:13:33 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:13:33 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:13:33 user nova-compute[75206]:   </cpu>
Nov 29 22:13:33 user nova-compute[75206]:   <devices>
Nov 29 22:13:33 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:13:33 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:13:33 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 22:13:33 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:13:33 user nova-compute[75206]:       <serial>b250ff38-6e1c-4d9e-870a-31c4e194b2f0</serial>
Nov 29 22:13:33 user nova-compute[75206]:     </disk>
Nov 29 22:13:33 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:13:33 user nova-compute[75206]:       <mac address="fa:16:3e:21:52:af"/>
Nov 29 22:13:33 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:13:33 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:13:33 user nova-compute[75206]:       <target dev="tapdba2f7b8-4a"/>
Nov 29 22:13:33 user nova-compute[75206]:     </interface>
Nov 29 22:13:33 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:13:33 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/3b80ec76-d54a-4144-90b5-c346321357e3/console.log" append="off"/>
Nov 29 22:13:33 user nova-compute[75206]:     </serial>
Nov 29 22:13:33 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:13:33 user nova-compute[75206]:     <video>
Nov 29 22:13:33 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:13:33 user nova-compute[75206]:     </video>
Nov 29 22:13:33 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:13:33 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:13:33 user nova-compute[75206]:     </rng>
Nov 29 22:13:33 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:13:33 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:13:33 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:13:33 user nova-compute[75206]:     </memballoon>
Nov 29 22:13:33 user nova-compute[75206]:   </devices>
Nov 29 22:13:33 user nova-compute[75206]: </domain>
Nov 29 22:13:33 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1118128040',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoaIt3Mnc58Vt9jIxjRE96OCvO0FOVqdA5dRRRIl26HYhpLO31XKrdml1+hLr9kOS4zFr+hagH9ku7MozBMHAo2/+P68Hj+uWowCqC7pZxbx9MU1LOwdxe+BOVwddy1kw==',key_name='tempest-keypair-1320551098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-fjpd8jgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=3b80ec76-d54a-4144-90b5-c346321357e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG os_vif [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5303b9f9-4589-5332-bad5-1a035752ba52', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdba2f7b8-4a, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdba2f7b8-4a, col_values=(('qos', UUID('ec98bc70-e647-45c0-90e0-f9c970860d3c')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdba2f7b8-4a, col_values=(('external_ids', {'iface-id': 'dba2f7b8-4a0c-487f-a583-654187224a82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:52:af', 'vm-uuid': '3b80ec76-d54a-4144-90b5-c346321357e3'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:33 user nova-compute[75206]: INFO os_vif [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a')
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:13:33 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:21:52:af, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] No waiting events found dispatching network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:13:34 user nova-compute[75206]: WARNING nova.compute.manager [req-362a9acf-7dfd-47aa-ade6-dde399cec1ce req-e3acbe91-e185-48c9-af98-bc24794ccc70 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received unexpected event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 for instance with vm_state building and task_state spawning.
Nov 29 22:13:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:13:36 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Instance spawned successfully.
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:13:36 user nova-compute[75206]: INFO nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:36 user nova-compute[75206]: DEBUG nova.compute.manager [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] No waiting events found dispatching network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:13:36 user nova-compute[75206]: WARNING nova.compute.manager [req-e578548d-cffc-4959-8647-87e010b65e1d req-32bbc594-e045-49c9-b49f-175438e7e0e8 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received unexpected event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 for instance with vm_state building and task_state spawning.
Nov 29 22:13:36 user nova-compute[75206]: INFO nova.compute.manager [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Took 13.43 seconds to build instance.
Nov 29 22:13:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-ad0bae30-fcaa-4eb0-ab0d-0bb6a5b98be3 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.548s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:13:40 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:13:40 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.985424041748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b80ec76-d54a-4144-90b5-c346321357e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:13:40 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:13:41 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:13:41 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:13:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:13:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:13:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:44 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:13:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:13:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:13:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:13:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:13:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:13:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:40 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:14:41 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:14:41 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=24.98316192626953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b80ec76-d54a-4144-90b5-c346321357e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:14:41 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:14:42 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:14:42 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:14:42 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:14:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:14:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:14:44 user nova-compute[75206]: INFO nova.compute.manager [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Detaching volume c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:14:44 user nova-compute[75206]: INFO nova.virt.block_device [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Attempting to driver detach volume c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 from mountpoint /dev/vdb
Nov 29 22:14:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Attempting to detach device vdb from instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:14:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:14:44 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:14:44 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:14:44 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:14:44 user nova-compute[75206]:   <serial>c4fb6902-edab-4cf0-91b9-e20b35c5fdf9</serial>
Nov 29 22:14:44 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 22:14:44 user nova-compute[75206]: </disk>
Nov 29 22:14:44 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:14:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdb from instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 from the persistent domain config.
Nov 29 22:14:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:14:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:14:45 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:14:45 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:14:45 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:14:45 user nova-compute[75206]:   <serial>c4fb6902-edab-4cf0-91b9-e20b35c5fdf9</serial>
Nov 29 22:14:45 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 22:14:45 user nova-compute[75206]: </disk>
Nov 29 22:14:45 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:14:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:14:46 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:14:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:14:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:14:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:05 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 is timed out.
Nov 29 22:15:05 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdb from instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 from the live domain config.
Nov 29 22:15:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuTiNlft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:15:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65aa60-78be-4d03-a0a2-97ea9a6a473e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:15:05 user nova-compute[75206]: No targets found.
Nov 29 22:15:05 user nova-compute[75206]: iSNS:
Nov 29 22:15:05 user nova-compute[75206]: No targets found.
Nov 29 22:15:05 user nova-compute[75206]: STATIC:
Nov 29 22:15:05 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9
Nov 29 22:15:05 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:15:05 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:15:05 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0
Nov 29 22:15:05 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:15:05 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:15:05 user nova-compute[75206]: FIRMWARE:
Nov 29 22:15:05 user nova-compute[75206]: No targets found.
Nov 29 22:15:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:15:05 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:15:05 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[97566626-189f-40a6-b58c-f61c6d36e160]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aca2b9-66da-4b6d-80c6-d88bdd5c1059]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:15:05 user nova-compute[75206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 (non-flash)
Nov 29 22:15:05 user nova-compute[75206]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81ef370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d77ce-cb74-435b-9908-cfd151eafa2e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500cb0e-18da-4ee1-99d9-19963be1c0eb]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafbb6df-a449-4467-bbcc-53c74f11d590]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[17292a95-7712-4dd3-ad88-97bb68280891]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996a70e-aab8-4096-bb15-ff3e9f0cfa01]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeb67a5-e54a-43a1-806e-efd94f0f38d8]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260]
Nov 29 22:15:05 user nova-compute[75206]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9, portal: 172.16.0.220,3260] successful.
Nov 29 22:15:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fb6902-edab-4cf0-91b9-e20b35c5fdf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb47f7f8-6f2b-4d6c-8e91-2307655aff33]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== disconnect_volume: return (313ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:15:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:15:06 user nova-compute[75206]: DEBUG nova.objects.instance [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:15:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-30ba5d4e-33ff-4d78-99d2-e99bc9d04be1 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75206) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:07 user nova-compute[75206]: WARNING nova.compute.manager [req-ff744615-0832-4ad9-b67b-f16543bff807 req-e5652d5e-c7b1-4c88-aadb-f6118c6c47ed service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state active and task_state powering-off.
Nov 29 22:15:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance destroyed successfully.
Nov 29 22:15:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f89dadd-a83e-4af9-9b28-2181466bee10 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:09 user nova-compute[75206]: WARNING nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:09 user nova-compute[75206]: WARNING nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:09 user nova-compute[75206]: WARNING nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:09 user nova-compute[75206]: WARNING nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:09 user nova-compute[75206]: WARNING nova.compute.manager [req-3709b172-a7df-4e3e-bb56-aee7f27f01a2 req-d52ac9c9-4c3a-44e5-b8b4-692815def30a service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state None.
Nov 29 22:15:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-changed-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG nova.compute.manager [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Refreshing instance network info cache due to event network-changed-dba2f7b8-4a0c-487f-a583-654187224a82. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] Acquiring lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] Acquired lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Refreshing network info cache for port dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updated VIF entry in instance network info cache for port dba2f7b8-4a0c-487f-a583-654187224a82. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG nova.network.neutron [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:14 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-19e926c1-4919-461d-aa0e-98580a09e822 req-9d22ac01-cf34-4a87-b337-0921b8ff38a4 service nova] Releasing lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:15:22 user nova-compute[75206]: INFO nova.compute.claims [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Claim successful on node user
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:15:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:15:22 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:15:22 user nova-compute[75206]: INFO nova.virt.block_device [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Booting with volume snapshot c58b95d4-8a46-4ebf-97ea-127bd458c6bb at /dev/vda
Nov 29 22:15:23 user nova-compute[75206]: DEBUG nova.policy [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:15:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:23 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Successfully created port: 935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Successfully updated port: 935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-changed-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.compute.manager [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Refreshing instance network info cache due to event network-changed-935e4fc4-7dcb-4847-a8e6-7794a2917586. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] Acquiring lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.network.neutron [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updating instance_info_cache with network_info: [{"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Instance network_info: |[{"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] Acquired lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:24 user nova-compute[75206]: DEBUG nova.network.neutron [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Refreshing network info cache for port 935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:15:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updated VIF entry in instance network info cache for port 935e4fc4-7dcb-4847-a8e6-7794a2917586. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:15:25 user nova-compute[75206]: DEBUG nova.network.neutron [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updating instance_info_cache with network_info: [{"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:25 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0ab2f5cf-96d0-415c-a7b2-3084cc9ae316 req-5a31780e-9291-4752-850b-63a6d59cdc3b service nova] Releasing lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e92ea7-d868-445f-a103-9daa80138244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e1f46a-cbb7-4119-9c1e-33a7a300bdba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba2fdbf-38f4-4fc9-89f0-89a077e79c9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e800502a-a801-49b8-82af-87de30c54512]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:15:28 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:15:28 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7f1e7b-2195-47cc-948b-9779551b86b3]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG os_brick.utils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:15:28 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updating existing volume attachment record: 642e6f62-d5d9-491b-b7a1-3d55add80767 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:15:31 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:36 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:15:39 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Creating image(s)
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Ensure instance console log exists: /opt/stack/data/nova/instances/8c14f86b-8407-43bc-a9c2-73ea84db8dc0/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Start _get_guest_xml network_info=[{"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T22:15:16Z,direct_url=<?>,disk_format='qcow2',id=377b3c41-5e5e-4028-b7b8-1ce6e555e911,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-111997283',owner='52051df2c77b4f8487b6922bea48503e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T22:15:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'attachment_id': '642e6f62-d5d9-491b-b7a1-3d55add80767', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOPorSun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c14f86b-8407-43bc-a9c2-73ea84db8dc0', 'attached_at': '', 'detached_at': '', 'volume_id': '2c873da6-cea1-40db-b67c-5e062923e703', 'serial': '2c873da6-cea1-40db-b67c-5e062923e703'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:15:39 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:39 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T22:15:16Z,direct_url=<?>,disk_format='qcow2',id=377b3c41-5e5e-4028-b7b8-1ce6e555e911,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-111997283',owner='52051df2c77b4f8487b6922bea48503e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T22:15:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOPorSun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:15:39 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:15:39 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:15:39 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28354a7-0d13-4ec3-a9d3-ebd9cffae086]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:15:39 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8741c1-2575-4304-b852-258fd3b4ae92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703] added
Nov 29 22:15:39 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb893367-0be5-4c2f-8238-c1f995d4ad28]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88b25b-7d48-40d1-b967-c1fc788234be]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOPorSun {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOPorSun" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322bc1a-f162-4732-9b28-8cc75c0b5f1b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOPorSun'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:39 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cdaedb-692d-4945-a8d6-3b3e6e37c4ce]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe978ba-f0c9-4ac0-842d-b87858960b5b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00fd34a-41c5-42c3-a122-e52b8a5b1e43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260]
Nov 29 22:15:40 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260] successful.
Nov 29 22:15:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66a4d53-df8b-406e-8e63-2ff20a3cfe52]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b545614-9d4d-406e-8add-0510f4896407]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)
Nov 29 22:15:40 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5037c08f-292b-445c-9ea5-5583e695e66e]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:15:40 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOPorSun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26333343262373561', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333343262373561', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-618621979',id=47,image_ref='377b3c41-5e5e-4028-b7b8-1ce6e555e911',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKa+3h3vBGimxwmm+I45D0mTjttRDDmA9gKZ3+qRhxkzeuMZgCPbHHPlhAwXzEeXSo4iBxZb/aStnVQEedmTlbAe5Bz2f596m3gzgRDWblc1kByRlZk+j73zeOpAhhSWA==',key_name='tempest-keypair-1242225628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-bsil0ipe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-174206339',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=8c14f86b-8407-43bc-a9c2-73ea84db8dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.objects.instance [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c14f86b-8407-43bc-a9c2-73ea84db8dc0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:15:41 user nova-compute[75206]:   <uuid>8c14f86b-8407-43bc-a9c2-73ea84db8dc0</uuid>
Nov 29 22:15:41 user nova-compute[75206]:   <name>instance-0000002f</name>
Nov 29 22:15:41 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:15:41 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:15:41 user nova-compute[75206]:   <metadata>
Nov 29 22:15:41 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:15:41 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-618621979</nova:name>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:15:39</nova:creationTime>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:15:41 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:15:41 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:owner>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:15:41 user nova-compute[75206]:       </nova:owner>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:root type="image" uuid="377b3c41-5e5e-4028-b7b8-1ce6e555e911"/>
Nov 29 22:15:41 user nova-compute[75206]:       <nova:ports>
Nov 29 22:15:41 user nova-compute[75206]:         <nova:port uuid="935e4fc4-7dcb-4847-a8e6-7794a2917586">
Nov 29 22:15:41 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 22:15:41 user nova-compute[75206]:         </nova:port>
Nov 29 22:15:41 user nova-compute[75206]:       </nova:ports>
Nov 29 22:15:41 user nova-compute[75206]:     </nova:instance>
Nov 29 22:15:41 user nova-compute[75206]:   </metadata>
Nov 29 22:15:41 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:15:41 user nova-compute[75206]:     <system>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="serial">8c14f86b-8407-43bc-a9c2-73ea84db8dc0</entry>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="uuid">8c14f86b-8407-43bc-a9c2-73ea84db8dc0</entry>
Nov 29 22:15:41 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:15:41 user nova-compute[75206]:     </system>
Nov 29 22:15:41 user nova-compute[75206]:   </sysinfo>
Nov 29 22:15:41 user nova-compute[75206]:   <os>
Nov 29 22:15:41 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:15:41 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:15:41 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:15:41 user nova-compute[75206]:   </os>
Nov 29 22:15:41 user nova-compute[75206]:   <features>
Nov 29 22:15:41 user nova-compute[75206]:     <acpi/>
Nov 29 22:15:41 user nova-compute[75206]:     <apic/>
Nov 29 22:15:41 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:15:41 user nova-compute[75206]:   </features>
Nov 29 22:15:41 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:15:41 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:15:41 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:15:41 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:15:41 user nova-compute[75206]:   </clock>
Nov 29 22:15:41 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:15:41 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:15:41 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:15:41 user nova-compute[75206]:   </cpu>
Nov 29 22:15:41 user nova-compute[75206]:   <devices>
Nov 29 22:15:41 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:15:41 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:15:41 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 22:15:41 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:15:41 user nova-compute[75206]:       <serial>2c873da6-cea1-40db-b67c-5e062923e703</serial>
Nov 29 22:15:41 user nova-compute[75206]:     </disk>
Nov 29 22:15:41 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:15:41 user nova-compute[75206]:       <mac address="fa:16:3e:65:0a:89"/>
Nov 29 22:15:41 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:15:41 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:15:41 user nova-compute[75206]:       <target dev="tap935e4fc4-7d"/>
Nov 29 22:15:41 user nova-compute[75206]:     </interface>
Nov 29 22:15:41 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:15:41 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/8c14f86b-8407-43bc-a9c2-73ea84db8dc0/console.log" append="off"/>
Nov 29 22:15:41 user nova-compute[75206]:     </serial>
Nov 29 22:15:41 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:15:41 user nova-compute[75206]:     <video>
Nov 29 22:15:41 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:15:41 user nova-compute[75206]:     </video>
Nov 29 22:15:41 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:15:41 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:15:41 user nova-compute[75206]:     </rng>
Nov 29 22:15:41 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:15:41 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:15:41 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:15:41 user nova-compute[75206]:     </memballoon>
Nov 29 22:15:41 user nova-compute[75206]:   </devices>
Nov 29 22:15:41 user nova-compute[75206]: </domain>
Nov 29 22:15:41 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-618621979',id=47,image_ref='377b3c41-5e5e-4028-b7b8-1ce6e555e911',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKa+3h3vBGimxwmm+I45D0mTjttRDDmA9gKZ3+qRhxkzeuMZgCPbHHPlhAwXzEeXSo4iBxZb/aStnVQEedmTlbAe5Bz2f596m3gzgRDWblc1kByRlZk+j73zeOpAhhSWA==',key_name='tempest-keypair-1242225628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-bsil0ipe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-174206339',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=8c14f86b-8407-43bc-a9c2-73ea84db8dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG os_vif [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66663c78-ece7-57a5-9a7f-ca8e712f60da', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap935e4fc4-7d, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap935e4fc4-7d, col_values=(('qos', UUID('381df897-09aa-420c-b550-69723b1d338f')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap935e4fc4-7d, col_values=(('external_ids', {'iface-id': '935e4fc4-7dcb-4847-a8e6-7794a2917586', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:0a:89', 'vm-uuid': '8c14f86b-8407-43bc-a9c2-73ea84db8dc0'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:41 user nova-compute[75206]: INFO os_vif [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d')
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:15:41 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:65:0a:89, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:44 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Instance spawned successfully.
Nov 29 22:15:44 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:44 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:44 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=24.971294403076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:15:45 user nova-compute[75206]: INFO nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b80ec76-d54a-4144-90b5-c346321357e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 8c14f86b-8407-43bc-a9c2-73ea84db8dc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:45 user nova-compute[75206]: INFO nova.compute.manager [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Took 22.76 seconds to build instance.
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-cd047db9-622a-4c5a-800f-7f94f777a1e7 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.911s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] No waiting events found dispatching network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:45 user nova-compute[75206]: WARNING nova.compute.manager [req-6804e58c-9d68-425f-8f19-6ceb496eeea7 req-89b52a44-bf86-4bf4-9cdf-97fa0be8011a service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received unexpected event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 for instance with vm_state active and task_state None.
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.193s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:15:45 user nova-compute[75206]: INFO nova.compute.claims [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Claim successful on node user
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:15:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.policy [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64efc46bfe804e7ab7f681153f8302c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de5dd143a5d4591b2d04774762c266e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:15:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Creating image(s)
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "/opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "/opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "/opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk 1073741824" returned: 0 in 0.059s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Successfully created port: b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.183s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Cannot resize image /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Ensure instance console log exists: /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] No waiting events found dispatching network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:47 user nova-compute[75206]: WARNING nova.compute.manager [req-b6e9bca4-7562-4d94-96f6-85a99fcc7e09 req-a1dc77b3-1eec-4cee-aada-1d746237366d service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received unexpected event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 for instance with vm_state active and task_state None.
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Successfully updated port: b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquired lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Releasing lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Instance network_info: |[{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Start _get_guest_xml network_info=[{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:15:47 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:47 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80726617',display_name='tempest-SnapshotDataIntegrityTests-server-80726617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80726617',id=48,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfvShyayNYXPtxnKI+5A7ILj+deO+bHMrcLjR1OnGeqmtybVH87vMlDDXnJTUy3rUp0e8F0xr2TCRVuaTgFQatBrkHNV4RygpeRiISznszlu//zMI2A4Q8L8YwHexhQEg==',key_name='tempest-keypair-1489884089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de5dd143a5d4591b2d04774762c266e',ramdisk_id='',reservation_id='r-cfl856ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2032178691',owner_user_name='tempest-SnapshotDataIntegrityTests-2032178691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64efc46bfe804e7ab7f681153f8302c8',uuid=03750708-8c0e-455e-a83b-5f8ca663c30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converting VIF {"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'pci_devices' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:15:47 user nova-compute[75206]:   <uuid>03750708-8c0e-455e-a83b-5f8ca663c30f</uuid>
Nov 29 22:15:47 user nova-compute[75206]:   <name>instance-00000030</name>
Nov 29 22:15:47 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:15:47 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:15:47 user nova-compute[75206]:   <metadata>
Nov 29 22:15:47 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:15:47 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-80726617</nova:name>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:15:47</nova:creationTime>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:15:47 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:15:47 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:owner>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:user uuid="64efc46bfe804e7ab7f681153f8302c8">tempest-SnapshotDataIntegrityTests-2032178691-project-member</nova:user>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:project uuid="3de5dd143a5d4591b2d04774762c266e">tempest-SnapshotDataIntegrityTests-2032178691</nova:project>
Nov 29 22:15:47 user nova-compute[75206]:       </nova:owner>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:15:47 user nova-compute[75206]:       <nova:ports>
Nov 29 22:15:47 user nova-compute[75206]:         <nova:port uuid="b183fab9-60ca-4bcd-bbf2-28aee7faca2f">
Nov 29 22:15:47 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 22:15:47 user nova-compute[75206]:         </nova:port>
Nov 29 22:15:47 user nova-compute[75206]:       </nova:ports>
Nov 29 22:15:47 user nova-compute[75206]:     </nova:instance>
Nov 29 22:15:47 user nova-compute[75206]:   </metadata>
Nov 29 22:15:47 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:15:47 user nova-compute[75206]:     <system>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="serial">03750708-8c0e-455e-a83b-5f8ca663c30f</entry>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="uuid">03750708-8c0e-455e-a83b-5f8ca663c30f</entry>
Nov 29 22:15:47 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:15:47 user nova-compute[75206]:     </system>
Nov 29 22:15:47 user nova-compute[75206]:   </sysinfo>
Nov 29 22:15:47 user nova-compute[75206]:   <os>
Nov 29 22:15:47 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:15:47 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:15:47 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:15:47 user nova-compute[75206]:   </os>
Nov 29 22:15:47 user nova-compute[75206]:   <features>
Nov 29 22:15:47 user nova-compute[75206]:     <acpi/>
Nov 29 22:15:47 user nova-compute[75206]:     <apic/>
Nov 29 22:15:47 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:15:47 user nova-compute[75206]:   </features>
Nov 29 22:15:47 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:15:47 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:15:47 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:15:47 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:15:47 user nova-compute[75206]:   </clock>
Nov 29 22:15:47 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:15:47 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:15:47 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:15:47 user nova-compute[75206]:   </cpu>
Nov 29 22:15:47 user nova-compute[75206]:   <devices>
Nov 29 22:15:47 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:15:47 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:15:47 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk"/>
Nov 29 22:15:47 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:15:47 user nova-compute[75206]:     </disk>
Nov 29 22:15:47 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:15:47 user nova-compute[75206]:       <mac address="fa:16:3e:81:26:f8"/>
Nov 29 22:15:47 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:15:47 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:15:47 user nova-compute[75206]:       <target dev="tapb183fab9-60"/>
Nov 29 22:15:47 user nova-compute[75206]:     </interface>
Nov 29 22:15:47 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:15:47 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/console.log" append="off"/>
Nov 29 22:15:47 user nova-compute[75206]:     </serial>
Nov 29 22:15:47 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:15:47 user nova-compute[75206]:     <video>
Nov 29 22:15:47 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:15:47 user nova-compute[75206]:     </video>
Nov 29 22:15:47 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:15:47 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:15:47 user nova-compute[75206]:     </rng>
Nov 29 22:15:47 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:15:47 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:15:47 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:15:47 user nova-compute[75206]:     </memballoon>
Nov 29 22:15:47 user nova-compute[75206]:   </devices>
Nov 29 22:15:47 user nova-compute[75206]: </domain>
Nov 29 22:15:47 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80726617',display_name='tempest-SnapshotDataIntegrityTests-server-80726617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80726617',id=48,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfvShyayNYXPtxnKI+5A7ILj+deO+bHMrcLjR1OnGeqmtybVH87vMlDDXnJTUy3rUp0e8F0xr2TCRVuaTgFQatBrkHNV4RygpeRiISznszlu//zMI2A4Q8L8YwHexhQEg==',key_name='tempest-keypair-1489884089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de5dd143a5d4591b2d04774762c266e',ramdisk_id='',reservation_id='r-cfl856ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2032178691',owner_user_name='tempest-SnapshotDataIntegrityTests-2032178691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:15:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64efc46bfe804e7ab7f681153f8302c8',uuid=03750708-8c0e-455e-a83b-5f8ca663c30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converting VIF {"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG os_vif [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e43d27c-c2ac-5e28-9199-d6dcf1635bc3', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb183fab9-60, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb183fab9-60, col_values=(('qos', UUID('7c639148-3bd0-4155-af76-56b4d20cafdf')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb183fab9-60, col_values=(('external_ids', {'iface-id': 'b183fab9-60ca-4bcd-bbf2-28aee7faca2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:26:f8', 'vm-uuid': '03750708-8c0e-455e-a83b-5f8ca663c30f'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:47 user nova-compute[75206]: INFO os_vif [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60')
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:15:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No VIF found with MAC fa:16:3e:81:26:f8, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Skipping network cache update for instance because it is Building. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-changed-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Refreshing instance network info cache due to event network-changed-b183fab9-60ca-4bcd-bbf2-28aee7faca2f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] Acquiring lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] Acquired lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Refreshing network info cache for port b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:49 user nova-compute[75206]: WARNING nova.compute.manager [req-5e7c2f49-97e7-4982-8dd5-bcef04031e00 req-959d9a25-f4fd-462b-958e-555dba7c5148 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state building and task_state spawning.
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updated VIF entry in instance network info cache for port b183fab9-60ca-4bcd-bbf2-28aee7faca2f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-33d89892-74d3-4ee6-8561-7237ad526693 req-7e2db972-3057-4403-9e83-b5d0e662bcfd service nova] Releasing lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:15:51 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Instance spawned successfully.
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:15:51 user nova-compute[75206]: INFO nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:15:51 user nova-compute[75206]: WARNING nova.compute.manager [req-b6bbc90c-5f82-4830-9e13-dbcbb5a29401 req-12a8436f-9ba9-4815-8659-e86f8cfdb90f service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state building and task_state spawning.
Nov 29 22:15:51 user nova-compute[75206]: INFO nova.compute.manager [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Took 6.57 seconds to build instance.
Nov 29 22:15:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b8173055-7ac7-4b8f-a76f-218eab95214a tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.679s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:15:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:15:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:15:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:43 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:16:46 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:16:46 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=24.941211700439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b80ec76-d54a-4144-90b5-c346321357e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 8c14f86b-8407-43bc-a9c2-73ea84db8dc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:16:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:16:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:16:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:16:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:16:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [{"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-3b80ec76-d54a-4144-90b5-c346321357e3" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:16:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:16:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:16:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquired lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'info_cache' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.neutron [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Releasing lock "refresh_cache-b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:16:58 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance destroyed successfully.
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'resources' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG os_vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ecc0b5c-70, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=273529d6-ea64-4115-91f3-d4a34fd856b4) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:58 user nova-compute[75206]: INFO os_vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start _get_guest_xml network_info=[{"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'numa_topology' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:16:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'vcpu_model' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'pci_devices' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:16:58 user nova-compute[75206]:   <uuid>b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</uuid>
Nov 29 22:16:58 user nova-compute[75206]:   <name>instance-0000002c</name>
Nov 29 22:16:58 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:16:58 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:16:58 user nova-compute[75206]:   <metadata>
Nov 29 22:16:58 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:16:58 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeTestJSON-server-904787670</nova:name>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:16:58</nova:creationTime>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:16:58 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:16:58 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:owner>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:user uuid="fec00476dc9c48e589ba6105b5b5cf7c">tempest-AttachVolumeTestJSON-1138208547-project-member</nova:user>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:project uuid="4edbbd3bc5d74985817fc88839c58e4f">tempest-AttachVolumeTestJSON-1138208547</nova:project>
Nov 29 22:16:58 user nova-compute[75206]:       </nova:owner>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:16:58 user nova-compute[75206]:       <nova:ports>
Nov 29 22:16:58 user nova-compute[75206]:         <nova:port uuid="3ecc0b5c-70ba-4fb7-b6df-80784221d4b8">
Nov 29 22:16:58 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 22:16:58 user nova-compute[75206]:         </nova:port>
Nov 29 22:16:58 user nova-compute[75206]:       </nova:ports>
Nov 29 22:16:58 user nova-compute[75206]:     </nova:instance>
Nov 29 22:16:58 user nova-compute[75206]:   </metadata>
Nov 29 22:16:58 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:16:58 user nova-compute[75206]:     <system>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="serial">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="uuid">b46c8fed-be56-42ef-9eae-cc3a08cc3ac4</entry>
Nov 29 22:16:58 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:16:58 user nova-compute[75206]:     </system>
Nov 29 22:16:58 user nova-compute[75206]:   </sysinfo>
Nov 29 22:16:58 user nova-compute[75206]:   <os>
Nov 29 22:16:58 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:16:58 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:16:58 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:16:58 user nova-compute[75206]:   </os>
Nov 29 22:16:58 user nova-compute[75206]:   <features>
Nov 29 22:16:58 user nova-compute[75206]:     <acpi/>
Nov 29 22:16:58 user nova-compute[75206]:     <apic/>
Nov 29 22:16:58 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:16:58 user nova-compute[75206]:   </features>
Nov 29 22:16:58 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:16:58 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:16:58 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:16:58 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:16:58 user nova-compute[75206]:   </clock>
Nov 29 22:16:58 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:16:58 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:16:58 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:16:58 user nova-compute[75206]:   </cpu>
Nov 29 22:16:58 user nova-compute[75206]:   <devices>
Nov 29 22:16:58 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:16:58 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:16:58 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk"/>
Nov 29 22:16:58 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:16:58 user nova-compute[75206]:     </disk>
Nov 29 22:16:58 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:16:58 user nova-compute[75206]:       <mac address="fa:16:3e:81:11:2f"/>
Nov 29 22:16:58 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:16:58 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:16:58 user nova-compute[75206]:       <target dev="tap3ecc0b5c-70"/>
Nov 29 22:16:58 user nova-compute[75206]:     </interface>
Nov 29 22:16:58 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:16:58 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/console.log" append="off"/>
Nov 29 22:16:58 user nova-compute[75206]:     </serial>
Nov 29 22:16:58 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:16:58 user nova-compute[75206]:     <video>
Nov 29 22:16:58 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:16:58 user nova-compute[75206]:     </video>
Nov 29 22:16:58 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:16:58 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:16:58 user nova-compute[75206]:     </rng>
Nov 29 22:16:58 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:16:58 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:16:58 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:16:58 user nova-compute[75206]:     </memballoon>
Nov 29 22:16:58 user nova-compute[75206]:   </devices>
Nov 29 22:16:58 user nova-compute[75206]: </domain>
Nov 29 22:16:58 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'trusted_certs' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Cannot resize image /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.objects.instance [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'migration_context' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.objects.base [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Object Instance<b46c8fed-be56-42ef-9eae-cc3a08cc3ac4> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75206) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG os_vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '954b17b0-64a4-59c6-bc0c-7475cbeb9ae9', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ecc0b5c-70, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ecc0b5c-70, col_values=(('qos', UUID('460cc633-2c9f-47fb-90e8-4baefcf9a198')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ecc0b5c-70, col_values=(('external_ids', {'iface-id': '3ecc0b5c-70ba-4fb7-b6df-80784221d4b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:11:2f', 'vm-uuid': 'b46c8fed-be56-42ef-9eae-cc3a08cc3ac4'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:16:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:16:59 user nova-compute[75206]: INFO os_vif [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:17:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:17:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:17:01 user nova-compute[75206]: WARNING nova.compute.manager [req-6ad6247e-ab4b-4585-a55f-b9d4cc3d1a43 req-c736c1ae-d06b-4489-b952-116446a012d2 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state powering-on.
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:17:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance rebooted successfully.
Nov 29 22:17:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-e88e55d1-0d26-4f8b-bcc0-885a10466f4d tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:17:03 user nova-compute[75206]: WARNING nova.compute.manager [req-43b7a716-3036-4d58-88b8-ab94e70931d9 req-1e5b6e44-67da-449d-b10a-86706d5f032f service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state stopped and task_state powering-on.
Nov 29 22:17:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:10 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-changed-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.compute.manager [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Refreshing instance network info cache due to event network-changed-935e4fc4-7dcb-4847-a8e6-7794a2917586. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] Acquiring lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] Acquired lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Refreshing network info cache for port 935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updated VIF entry in instance network info cache for port 935e4fc4-7dcb-4847-a8e6-7794a2917586. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.network.neutron [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updating instance_info_cache with network_info: [{"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-414160ef-7749-432a-b99e-4d5e6abdd342 req-c2b90fb3-05b3-4742-b8f8-033fb6e98c91 service nova] Releasing lock "refresh_cache-8c14f86b-8407-43bc-a9c2-73ea84db8dc0" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:13 user nova-compute[75206]: INFO nova.compute.manager [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Terminating instance
Nov 29 22:17:13 user nova-compute[75206]: DEBUG nova.compute.manager [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Instance destroyed successfully.
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.objects.instance [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid 8c14f86b-8407-43bc-a9c2-73ea84db8dc0 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-618621979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-618621979',id=47,image_ref='377b3c41-5e5e-4028-b7b8-1ce6e555e911',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKa+3h3vBGimxwmm+I45D0mTjttRDDmA9gKZ3+qRhxkzeuMZgCPbHHPlhAwXzEeXSo4iBxZb/aStnVQEedmTlbAe5Bz2f596m3gzgRDWblc1kByRlZk+j73zeOpAhhSWA==',key_name='tempest-keypair-1242225628',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:15:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-bsil0ipe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-174206339',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=8c14f86b-8407-43bc-a9c2-73ea84db8dc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "address": "fa:16:3e:65:0a:89", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935e4fc4-7d", "ovs_interfaceid": "935e4fc4-7dcb-4847-a8e6-7794a2917586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_vif [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap935e4fc4-7d, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=381df897-09aa-420c-b550-69723b1d338f) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:17:14 user nova-compute[75206]: INFO os_vif [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:0a:89,bridge_name='br-int',has_traffic_filtering=True,id=935e4fc4-7dcb-4847-a8e6-7794a2917586,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935e4fc4-7d')
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOPorSun', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:17:14 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[627546d4-9fd4-48a1-9bee-02b8657a9824]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:17:14 user nova-compute[75206]: No targets found.
Nov 29 22:17:14 user nova-compute[75206]: iSNS:
Nov 29 22:17:14 user nova-compute[75206]: No targets found.
Nov 29 22:17:14 user nova-compute[75206]: STATIC:
Nov 29 22:17:14 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703
Nov 29 22:17:14 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:17:14 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:17:14 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0
Nov 29 22:17:14 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:17:14 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:17:14 user nova-compute[75206]: FIRMWARE:
Nov 29 22:17:14 user nova-compute[75206]: No targets found.
Nov 29 22:17:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:17:14 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:17:14 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d160ad-a23f-4314-9f0c-7f562f0a014b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24baeb-f82e-4966-aaf8-9d60cc908968]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:14 user nova-compute[75206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)
Nov 29 22:17:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:14 user nova-compute[75206]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 (non-flash)
Nov 29 22:17:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c827b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272fea7-1847-4c3d-b78b-21637ca9c587]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13824978-dada-47e6-b439-5380881cb1c3]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcbeb69-ee3f-48e4-84b8-8df2ea95f318]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[32038a1d-cf4b-4354-8109-2a245c3664a5]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26333343262373561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a49e0aaf', '/dev/disk/by-id/scsi-1SCST_BIOa49e0aaf-c342b75a9d109414') {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3088b1fa-482a-43f1-8fb5-4aa8d0f7db34]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b0ec3-b5ff-47ac-a206-5d19645fc425]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4322eb9e-a139-4311-a711-606ff3a9c813]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260]
Nov 29 22:17:14 user nova-compute[75206]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703, portal: 172.16.0.220,3260] successful.
Nov 29 22:17:14 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c873da6-cea1-40db-b67c-5e062923e703 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9816d0f0-5c3b-4535-8f76-29f0d5d47f43]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (320ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:17:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Deleting instance files /opt/stack/data/nova/instances/8c14f86b-8407-43bc-a9c2-73ea84db8dc0_del
Nov 29 22:17:14 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Deletion of /opt/stack/data/nova/instances/8c14f86b-8407-43bc-a9c2-73ea84db8dc0_del complete
Nov 29 22:17:14 user nova-compute[75206]: INFO nova.compute.manager [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 22:17:14 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:17:14 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-unplugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] No waiting events found dispatching network-vif-unplugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-unplugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Acquiring lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] No waiting events found dispatching network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:17:15 user nova-compute[75206]: WARNING nova.compute.manager [req-0298f630-aa7c-4008-bc0d-26347d498d3c req-80e16b9e-69b3-4394-93d5-0b2e9ef40b28 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received unexpected event network-vif-plugged-935e4fc4-7dcb-4847-a8e6-7794a2917586 for instance with vm_state active and task_state deleting.
Nov 29 22:17:15 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:17:15 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Took 0.61 seconds to deallocate network for instance.
Nov 29 22:17:16 user nova-compute[75206]: INFO nova.compute.manager [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.compute.manager [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Deleting volume: 2c873da6-cea1-40db-b67c-5e062923e703 {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:17:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:16 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance 8c14f86b-8407-43bc-a9c2-73ea84db8dc0
Nov 29 22:17:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-f9ae4ac3-81ae-4529-ae80-170f728ce1c1 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "8c14f86b-8407-43bc-a9c2-73ea84db8dc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:17 user nova-compute[75206]: DEBUG nova.compute.manager [req-e01ff695-bcfe-4d46-8e9a-1c7efecfbbc9 req-8b48042d-b540-442f-ab25-e3963eed99c4 service nova] [instance: 8c14f86b-8407-43bc-a9c2-73ea84db8dc0] Received event network-vif-deleted-935e4fc4-7dcb-4847-a8e6-7794a2917586 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-changed-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Refreshing instance network info cache due to event network-changed-b183fab9-60ca-4bcd-bbf2-28aee7faca2f. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] Acquiring lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] Acquired lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:17:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Refreshing network info cache for port b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:17:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updated VIF entry in instance network info cache for port b183fab9-60ca-4bcd-bbf2-28aee7faca2f. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:17:35 user nova-compute[75206]: DEBUG nova.network.neutron [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:17:35 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a9910af6-aded-4758-9a7c-371bd8aa3ac8 req-ba94fc9b-76a1-42d6-a511-1f0fc53d3392 service nova] Releasing lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:17:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:38 user nova-compute[75206]: INFO nova.compute.manager [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attaching volume 82e6dea2-3acd-4365-b41e-e6da20fa83a9 to /dev/vdb
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.utils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbef928-e565-4704-86bd-89f463fafbac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6ff989-0c27-498e-a5f5-c3eecb6c0a06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8489f-e059-4d4f-af50-1e6c35e5779b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c6907a-0007-402b-a7eb-c0f092f048ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:17:38 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:17:38 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cb84cd-5a26-4958-8cb0-eddd6ed633ca]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG os_brick.utils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:17:38 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating existing volume attachment record: dc6b98d0-0f71-453f-9765-744a9f1dec2b {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:17:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRDLJNjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:17:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:17:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:17:45 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[119eaaf6-63a6-4551-bffc-050c40597a9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:17:45 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffcb410-8e7d-417c-b8c0-f68da392f6e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9] added
Nov 29 22:17:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b00bc-c77c-40d4-b436-fb68f21b339e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1287a2b-e128-4922-a78a-f70bee6c5ff0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRDLJNjx {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRDLJNjx" returned: 0 in 0.024s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5fef6-e2cc-4edb-b9b4-87c43fecccff]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRDLJNjx'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e0c456-5c54-4ecb-b59e-00a37dc4b989]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5fd758-8ad0-41e0-bfa0-6a7f84c760e5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74409a-0ee1-4ae2-b4a0-9bf095ae1086]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260]
Nov 29 22:17:46 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260] successful.
Nov 29 22:17:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df6671b-4f35-4126-886f-6c7ed9b43120]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf641c-401a-431c-be19-712949b70115]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:17:46 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c7efc8-0fde-47bd-a43d-b00bfdbed90f]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:17:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRDLJNjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26531633762336662', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633762336662', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:17:47 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:17:47 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:17:47 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:17:47 user nova-compute[75206]:   <serial>82e6dea2-3acd-4365-b41e-e6da20fa83a9</serial>
Nov 29 22:17:47 user nova-compute[75206]: </disk>
Nov 29 22:17:47 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No VIF found with MAC fa:16:3e:81:26:f8, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d32c2991-3414-486a-ada7-e6c8ad8e31bf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.548s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:17:47 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:17:48 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:17:48 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=24.931270599365234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b80ec76-d54a-4144-90b5-c346321357e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:17:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:17:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:17:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:17:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:17:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:53 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:17:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:17:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:17:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:04 user nova-compute[75206]: INFO nova.compute.manager [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Detaching volume 82e6dea2-3acd-4365-b41e-e6da20fa83a9
Nov 29 22:18:04 user nova-compute[75206]: INFO nova.virt.block_device [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attempting to driver detach volume 82e6dea2-3acd-4365-b41e-e6da20fa83a9 from mountpoint /dev/vdb
Nov 29 22:18:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Attempting to detach device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:18:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:18:04 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:18:04 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:18:04 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:18:04 user nova-compute[75206]:   <serial>82e6dea2-3acd-4365-b41e-e6da20fa83a9</serial>
Nov 29 22:18:04 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:18:04 user nova-compute[75206]: </disk>
Nov 29 22:18:04 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:18:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config.
Nov 29 22:18:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:18:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:18:04 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:18:04 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:18:04 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:18:04 user nova-compute[75206]:   <serial>82e6dea2-3acd-4365-b41e-e6da20fa83a9</serial>
Nov 29 22:18:04 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:18:04 user nova-compute[75206]: </disk>
Nov 29 22:18:04 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:18:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:18:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:08 user nova-compute[75206]: INFO nova.compute.manager [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Terminating instance
Nov 29 22:18:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-unplugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] No waiting events found dispatching network-vif-unplugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-a30ecea5-eca7-48d8-aa26-3bf73501937c req-540aaa94-ed5f-42bd-b3eb-15b85818af94 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-unplugged-dba2f7b8-4a0c-487f-a583-654187224a82 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:18:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Instance destroyed successfully.
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.objects.instance [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid 3b80ec76-d54a-4144-90b5-c346321357e3 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1118128040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1118128040',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoaIt3Mnc58Vt9jIxjRE96OCvO0FOVqdA5dRRRIl26HYhpLO31XKrdml1+hLr9kOS4zFr+hagH9ku7MozBMHAo2/+P68Hj+uWowCqC7pZxbx9MU1LOwdxe+BOVwddy1kw==',key_name='tempest-keypair-1320551098',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-fjpd8jgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a98f791449794479934ed124c0993117',uuid=3b80ec76-d54a-4144-90b5-c346321357e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "dba2f7b8-4a0c-487f-a583-654187224a82", "address": "fa:16:3e:21:52:af", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba2f7b8-4a", "ovs_interfaceid": "dba2f7b8-4a0c-487f-a583-654187224a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_vif [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdba2f7b8-4a, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec98bc70-e647-45c0-90e0-f9c970860d3c) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:09 user nova-compute[75206]: INFO os_vif [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:52:af,bridge_name='br-int',has_traffic_filtering=True,id=dba2f7b8-4a0c-487f-a583-654187224a82,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba2f7b8-4a')
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPqKUgwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:18:09 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b368c0dd-9966-42b5-97e5-f3cc3e9cb83c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:18:09 user nova-compute[75206]: No targets found.
Nov 29 22:18:09 user nova-compute[75206]: iSNS:
Nov 29 22:18:09 user nova-compute[75206]: No targets found.
Nov 29 22:18:09 user nova-compute[75206]: STATIC:
Nov 29 22:18:09 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9
Nov 29 22:18:09 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:18:09 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:18:09 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0
Nov 29 22:18:09 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:18:09 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:18:09 user nova-compute[75206]: FIRMWARE:
Nov 29 22:18:09 user nova-compute[75206]: No targets found.
Nov 29 22:18:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:18:09 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:18:09 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250e10f-fece-46d9-8e27-03dd01f9d8ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ff180-abfe-436c-b544-ab13a022b66e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:18:09 user nova-compute[75206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:18:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 (non-flash)
Nov 29 22:18:09 user nova-compute[75206]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:18:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8201750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c34c5f-7548-4374-9afb-fd2a14ecbb1d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc0f69-d014-4757-a0cc-7075eec8ef4b]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fe7426-555a-4af7-8e17-6b0c73ac0547]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee38195-c89a-4e08-82a6-9b0bdd22e8e9]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4aaa22-2295-4592-9fe1-b4e730674cd9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f579a-5e9b-4183-8007-004e1fa2f6ec]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260]
Nov 29 22:18:09 user nova-compute[75206]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0, portal: 172.16.0.220,3260] successful.
Nov 29 22:18:09 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b250ff38-6e1c-4d9e-870a-31c4e194b2f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc1996-c5e8-4567-848d-179339842db0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (298ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:18:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Deleting instance files /opt/stack/data/nova/instances/3b80ec76-d54a-4144-90b5-c346321357e3_del
Nov 29 22:18:09 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Deletion of /opt/stack/data/nova/instances/3b80ec76-d54a-4144-90b5-c346321357e3_del complete
Nov 29 22:18:09 user nova-compute[75206]: INFO nova.compute.manager [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 22:18:09 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:18:09 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:18:10 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Took 0.66 seconds to deallocate network for instance.
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-7db4c194-15eb-4b2c-87dd-6807841d9607 req-ab51c344-3363-4692-a3ae-338f1eae1633 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-deleted-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:10 user nova-compute[75206]: INFO nova.compute.manager [req-7db4c194-15eb-4b2c-87dd-6807841d9607 req-ab51c344-3363-4692-a3ae-338f1eae1633 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Neutron deleted interface dba2f7b8-4a0c-487f-a583-654187224a82; detaching it from the instance and deleting it from the info cache
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.network.neutron [req-7db4c194-15eb-4b2c-87dd-6807841d9607 req-ab51c344-3363-4692-a3ae-338f1eae1633 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-7db4c194-15eb-4b2c-87dd-6807841d9607 req-ab51c344-3363-4692-a3ae-338f1eae1633 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Detach interface failed, port_id=dba2f7b8-4a0c-487f-a583-654187224a82, reason: Instance 3b80ec76-d54a-4144-90b5-c346321357e3 could not be found. {{(pid=75206) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] Acquiring lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] Lock "3b80ec76-d54a-4144-90b5-c346321357e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.compute.manager [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] No waiting events found dispatching network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:18:10 user nova-compute[75206]: WARNING nova.compute.manager [req-1e423d53-f8ac-4096-b8cd-f373ac74e966 req-e2505cd2-34d2-42cb-9eec-3b503a2c9780 service nova] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Received unexpected event network-vif-plugged-dba2f7b8-4a0c-487f-a583-654187224a82 for instance with vm_state active and task_state deleting.
Nov 29 22:18:10 user nova-compute[75206]: INFO nova.compute.manager [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 22:18:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b80ec76-d54a-4144-90b5-c346321357e3] Deleting volume: b250ff38-6e1c-4d9e-870a-31c4e194b2f0 {{(pid=75206) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 22:18:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:11 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:18:11 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:18:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:11 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance 3b80ec76-d54a-4144-90b5-c346321357e3
Nov 29 22:18:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-eff64984-f04f-43cf-bbeb-2eb27c3e91ff tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b80ec76-d54a-4144-90b5-c346321357e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:25 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f is timed out.
Nov 29 22:18:25 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config.
Nov 29 22:18:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRDLJNjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:18:25 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8532be0-a1c1-44f7-9998-e05b39a6c78f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:18:25 user nova-compute[75206]: No targets found.
Nov 29 22:18:25 user nova-compute[75206]: iSNS:
Nov 29 22:18:25 user nova-compute[75206]: No targets found.
Nov 29 22:18:25 user nova-compute[75206]: STATIC:
Nov 29 22:18:25 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9
Nov 29 22:18:25 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:18:25 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:18:25 user nova-compute[75206]: FIRMWARE:
Nov 29 22:18:25 user nova-compute[75206]: No targets found.
Nov 29 22:18:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:18:25 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:18:25 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[754aa21b-754f-414f-a5f4-a2f1e51afe3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e827c1-7ec3-4b91-87e1-0101bb983208]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:18:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 (non-flash)
Nov 29 22:18:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8256c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8201650-82aa-4173-b3b5-c30bdad2299a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c8e42-108f-4893-a631-9a256b46eeda]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec232c3-a44b-4c06-ac77-7b07f7e3667d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7de1e7b-deb6-4a0c-8e2b-563a817caec9]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9786e2-c378-414a-b6a8-68cb15ef16c5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b725a8-8a82-4acd-a414-c299f5b479d5]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260]
Nov 29 22:18:25 user nova-compute[75206]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9, portal: 172.16.0.220,3260] successful.
Nov 29 22:18:25 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82e6dea2-3acd-4365-b41e-e6da20fa83a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7deeab-e13e-45b4-851d-00a191faa09e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== disconnect_volume: return (284ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:18:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:18:26 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:18:26 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9dd57c09-d1d5-4b60-96ed-4eaf91306cd0 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:18:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:18:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:49 user nova-compute[75206]: INFO nova.compute.manager [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Terminating instance
Nov 29 22:18:49 user nova-compute[75206]: DEBUG nova.compute.manager [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:18:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-87a55e6e-147c-46c8-a08e-9f968bb8dd2a req-8c0dd56f-6d05-453e-9512-2b3400f772d6 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-unplugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:18:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Instance destroyed successfully.
Nov 29 22:18:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:18:50 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=24.92995834350586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'resources' on Instance uuid b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:08:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904787670',display_name='tempest-AttachVolumeTestJSON-server-904787670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904787670',id=44,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2xg2PiXy61/42karoSCiq2ecVCTCD1wYsGcoRF8qyJLEEIOJPmJcY/53mNbTiHqo3CaYLS5/KN/N45/1AEOrJkVSmJenyw2/HYxLe11W5BkOXdJ2XMDbL89MeZqKxmhw==',key_name='tempest-keypair-266525461',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-i2knfc16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=b46c8fed-be56-42ef-9eae-cc3a08cc3ac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "address": "fa:16:3e:81:11:2f", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecc0b5c-70", "ovs_interfaceid": "3ecc0b5c-70ba-4fb7-b6df-80784221d4b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG os_vif [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ecc0b5c-70, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=460cc633-2c9f-47fb-90e8-4baefcf9a198) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:18:50 user nova-compute[75206]: INFO os_vif [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:2f,bridge_name='br-int',has_traffic_filtering=True,id=3ecc0b5c-70ba-4fb7-b6df-80784221d4b8,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ecc0b5c-70')
Nov 29 22:18:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Deleting instance files /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4_del
Nov 29 22:18:50 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Deletion of /opt/stack/data/nova/instances/b46c8fed-be56-42ef-9eae-cc3a08cc3ac4_del complete
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:18:50 user nova-compute[75206]: INFO nova.compute.manager [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 29 22:18:50 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:18:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:18:51 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Took 0.66 seconds to deallocate network for instance.
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-b79e954d-1b8c-4976-8147-f09bcd8fe53c req-68632933-7878-41fb-852d-2304b4d0670d service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-deleted-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:51 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Deleted allocations for instance b46c8fed-be56-42ef-9eae-cc3a08cc3ac4
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-36c8e23a-3bb7-47f9-a0c1-ff7877732038 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] Acquiring lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] Lock "b46c8fed-be56-42ef-9eae-cc3a08cc3ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:51 user nova-compute[75206]: DEBUG nova.compute.manager [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] No waiting events found dispatching network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:18:51 user nova-compute[75206]: WARNING nova.compute.manager [req-1d83ffb6-7885-48af-88ab-96c6cc79c61c req-24635e00-1f34-4a59-84ec-7ce977e2a489 service nova] [instance: b46c8fed-be56-42ef-9eae-cc3a08cc3ac4] Received unexpected event network-vif-plugged-3ecc0b5c-70ba-4fb7-b6df-80784221d4b8 for instance with vm_state deleted and task_state None.
Nov 29 22:18:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:18:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:18:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:18:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:18:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:18:57 user nova-compute[75206]: INFO nova.compute.manager [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attaching volume 5be67d47-5653-44dd-8d75-46896a62fddc to /dev/vdb
Nov 29 22:18:57 user nova-compute[75206]: DEBUG os_brick.utils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[929431fb-3d5b-4430-a692-9ed5e49a296f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:57 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9d13e-81bf-4734-986b-3e664ead5ad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e1cf36-2dbd-4f8c-88bd-b00b63fc98ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47efce36-d7d4-4c7b-bfcf-4a315b6eca6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:18:58 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:18:58 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c534f9ef-adad-4d23-822e-c22ed4bdf00e]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG os_brick.utils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:18:58 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating existing volume attachment record: 652dce78-9a1f-4f85-a17a-d20059c59082 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:18:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMUXFAtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:19:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:19:05 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:19:05 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8baefc-5946-4fb2-9255-7767e8de07d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:19:05 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc67f4a-cee1-43b4-aaa6-b6b4bcc9f2fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc] added
Nov 29 22:19:05 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:05 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c6ce0-eb61-4a8c-9643-62105a3df873]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d7936a-f885-4673-b4b1-809920d4fd97]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMUXFAtG {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMUXFAtG" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d894e5-b71f-4018-b0fb-67cd84def945]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMUXFAtG'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b8485-4491-4a83-880b-54afb4cffdc8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f381c4-1704-41d6-8339-185eef85c234]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:19:06 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:19:06 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:19:06 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 22:19:06 user nova-compute[75206]: 
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc657e7-e7dc-4d92-bf5e-a596c7edf248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260]
Nov 29 22:19:06 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260] successful.
Nov 29 22:19:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd82f57-3116-41f0-9b4f-4d6b4c635b46]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9fd09-445c-491b-95ea-f1996280ec2e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:06 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c566f-aca3-4680-830b-ccec03c3aada]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:06 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMUXFAtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26164613835346438', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164613835346438', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.objects.instance [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:19:07 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:19:07 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:19:07 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:19:07 user nova-compute[75206]:   <serial>5be67d47-5653-44dd-8d75-46896a62fddc</serial>
Nov 29 22:19:07 user nova-compute[75206]: </disk>
Nov 29 22:19:07 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No VIF found with MAC fa:16:3e:81:26:f8, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:19:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-d60d7098-9136-4169-9b7a-8e8fea433dc5 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.922s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:19:09 user nova-compute[75206]: INFO nova.compute.claims [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Claim successful on node user
Nov 29 22:19:09 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:19:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:19:10 user nova-compute[75206]: INFO nova.virt.block_device [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Booting with volume 3a89b249-1376-457e-ac6f-0cdd073175ef at /dev/vda
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.policy [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.utils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[717297ca-4ca8-4b93-b3d0-674c889e685c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c008d64-b165-4e9a-b0e2-ee4414656dba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbfae5b-8799-4643-a652-8b65cec155c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba009c-0526-4488-b4ea-54c3c00354b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:19:10 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:19:10 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a0d89-2de1-4053-a8af-8a965a8fac7e]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG os_brick.utils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating existing volume attachment record: c8953509-bddc-4d4a-9dc8-0c8f898ebc97 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:19:10 user nova-compute[75206]: INFO nova.compute.manager [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Detaching volume 5be67d47-5653-44dd-8d75-46896a62fddc
Nov 29 22:19:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:10 user nova-compute[75206]: INFO nova.virt.block_device [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attempting to driver detach volume 5be67d47-5653-44dd-8d75-46896a62fddc from mountpoint /dev/vdb
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Attempting to detach device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:19:10 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:19:10 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:19:10 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:19:10 user nova-compute[75206]:   <serial>5be67d47-5653-44dd-8d75-46896a62fddc</serial>
Nov 29 22:19:10 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:19:10 user nova-compute[75206]: </disk>
Nov 29 22:19:10 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:19:10 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config.
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:19:10 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:19:10 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:19:10 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:19:10 user nova-compute[75206]:   <serial>5be67d47-5653-44dd-8d75-46896a62fddc</serial>
Nov 29 22:19:10 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:19:10 user nova-compute[75206]: </disk>
Nov 29 22:19:10 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Successfully created port: 93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:19:10 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Successfully updated port: 93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-changed-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.compute.manager [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Refreshing instance network info cache due to event network-changed-93a663e7-e847-4bf2-85e4-cfd55ecd0368. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] Acquiring lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.network.neutron [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating instance_info_cache with network_info: [{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Instance network_info: |[{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] Acquired lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:19:11 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Refreshing network info cache for port 93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:19:12 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updated VIF entry in instance network info cache for port 93a663e7-e847-4bf2-85e4-cfd55ecd0368. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:19:12 user nova-compute[75206]: DEBUG nova.network.neutron [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating instance_info_cache with network_info: [{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:19:12 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ba3f7116-4d8b-4a2f-82f9-810fc989c7c4 req-494cb996-4197-4e6e-bf12-de783ae80d5b service nova] Releasing lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:19:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:19:18 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Creating image(s)
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Ensure instance console log exists: /opt/stack/data/nova/instances/10b5c2ca-2d45-4b9f-8221-77622b3d7e2b/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Start _get_guest_xml network_info=[{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'c8953509-bddc-4d4a-9dc8-0c8f898ebc97', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10b5c2ca-2d45-4b9f-8221-77622b3d7e2b', 'attached_at': '', 'detached_at': '', 'volume_id': '3a89b249-1376-457e-ac6f-0cdd073175ef', 'serial': '3a89b249-1376-457e-ac6f-0cdd073175ef'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:19:18 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:18 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:19:18 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:19:18 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:19:18 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[587699f0-ce6d-444b-84d6-29469846d4d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:19:18 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2ccd8-724b-43f8-a77d-8965f5bfed81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef] added
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf252bff-15d8-4a6b-a795-9431ee7f2a98]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd18b7b6-af0b-4aa3-9564-3330df2f952e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTzSJWxr {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTzSJWxr" returned: 0 in 0.073s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a169d6-d5d9-45e3-895d-36f03e94ec2e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTzSJWxr'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.114s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c65551d-b742-4fae-ac0c-4e5a152e2c23]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a087e9-6c6c-4e7b-a742-39449a8dbc5b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb867f1-c20b-4900-8371-f41d7fd98bf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]
Nov 29 22:19:18 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511a955-ecdc-44b7-9e4c-6fd319ffd4c5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd32416-630a-4cd0-b702-116e99680a80]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:18 user nova-compute[75206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:18 user nova-compute[75206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:19:18 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4e9cf-b96a-4a7e-abe5-67ab3024d718]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:18 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26539663738663036', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539663738663036', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1011851678',display_name='tempest-TestVolumeBootPattern-server-1011851678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1011851678',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-v4f703hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:19:10Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=10b5c2ca-2d45-4b9f-8221-77622b3d7e2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.objects.instance [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:19:19 user nova-compute[75206]:   <uuid>10b5c2ca-2d45-4b9f-8221-77622b3d7e2b</uuid>
Nov 29 22:19:19 user nova-compute[75206]:   <name>instance-00000031</name>
Nov 29 22:19:19 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:19:19 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:19:19 user nova-compute[75206]:   <metadata>
Nov 29 22:19:19 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:19:19 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:19:19 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-server-1011851678</nova:name>
Nov 29 22:19:19 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:19:18</nova:creationTime>
Nov 29 22:19:19 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:19:19 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:19:19 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:19:19 user nova-compute[75206]:       <nova:owner>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:19:19 user nova-compute[75206]:       </nova:owner>
Nov 29 22:19:19 user nova-compute[75206]:       <nova:ports>
Nov 29 22:19:19 user nova-compute[75206]:         <nova:port uuid="93a663e7-e847-4bf2-85e4-cfd55ecd0368">
Nov 29 22:19:19 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 22:19:19 user nova-compute[75206]:         </nova:port>
Nov 29 22:19:19 user nova-compute[75206]:       </nova:ports>
Nov 29 22:19:19 user nova-compute[75206]:     </nova:instance>
Nov 29 22:19:19 user nova-compute[75206]:   </metadata>
Nov 29 22:19:19 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:19:19 user nova-compute[75206]:     <system>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="serial">10b5c2ca-2d45-4b9f-8221-77622b3d7e2b</entry>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="uuid">10b5c2ca-2d45-4b9f-8221-77622b3d7e2b</entry>
Nov 29 22:19:19 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:19:19 user nova-compute[75206]:     </system>
Nov 29 22:19:19 user nova-compute[75206]:   </sysinfo>
Nov 29 22:19:19 user nova-compute[75206]:   <os>
Nov 29 22:19:19 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:19:19 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:19:19 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:19:19 user nova-compute[75206]:   </os>
Nov 29 22:19:19 user nova-compute[75206]:   <features>
Nov 29 22:19:19 user nova-compute[75206]:     <acpi/>
Nov 29 22:19:19 user nova-compute[75206]:     <apic/>
Nov 29 22:19:19 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:19:19 user nova-compute[75206]:   </features>
Nov 29 22:19:19 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:19:19 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:19:19 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:19:19 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:19:19 user nova-compute[75206]:   </clock>
Nov 29 22:19:19 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:19:19 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:19:19 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:19:19 user nova-compute[75206]:   </cpu>
Nov 29 22:19:19 user nova-compute[75206]:   <devices>
Nov 29 22:19:19 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:19:19 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:19:19 user nova-compute[75206]:       <source dev="/dev/sdc"/>
Nov 29 22:19:19 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:19:19 user nova-compute[75206]:       <serial>3a89b249-1376-457e-ac6f-0cdd073175ef</serial>
Nov 29 22:19:19 user nova-compute[75206]:     </disk>
Nov 29 22:19:19 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:19:19 user nova-compute[75206]:       <mac address="fa:16:3e:61:6e:93"/>
Nov 29 22:19:19 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:19:19 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:19:19 user nova-compute[75206]:       <target dev="tap93a663e7-e8"/>
Nov 29 22:19:19 user nova-compute[75206]:     </interface>
Nov 29 22:19:19 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:19:19 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/10b5c2ca-2d45-4b9f-8221-77622b3d7e2b/console.log" append="off"/>
Nov 29 22:19:19 user nova-compute[75206]:     </serial>
Nov 29 22:19:19 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:19:19 user nova-compute[75206]:     <video>
Nov 29 22:19:19 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:19:19 user nova-compute[75206]:     </video>
Nov 29 22:19:19 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:19:19 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:19:19 user nova-compute[75206]:     </rng>
Nov 29 22:19:19 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:19:19 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:19:19 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:19:19 user nova-compute[75206]:     </memballoon>
Nov 29 22:19:19 user nova-compute[75206]:   </devices>
Nov 29 22:19:19 user nova-compute[75206]: </domain>
Nov 29 22:19:19 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1011851678',display_name='tempest-TestVolumeBootPattern-server-1011851678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1011851678',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-v4f703hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:19:10Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=10b5c2ca-2d45-4b9f-8221-77622b3d7e2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG os_vif [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7e3f5b7-44cb-58fa-9603-ae5e042e136b', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93a663e7-e8, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93a663e7-e8, col_values=(('qos', UUID('02505c83-e330-4df7-afce-bfa048efcd40')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93a663e7-e8, col_values=(('external_ids', {'iface-id': '93a663e7-e847-4bf2-85e4-cfd55ecd0368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:6e:93', 'vm-uuid': '10b5c2ca-2d45-4b9f-8221-77622b3d7e2b'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:19 user nova-compute[75206]: INFO os_vif [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8')
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:19:19 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:61:6e:93, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:19:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG nova.compute.manager [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] No waiting events found dispatching network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:19:21 user nova-compute[75206]: WARNING nova.compute.manager [req-735ee684-26c5-413e-b16d-32373dee01ce req-bbe393b5-24e9-4cac-945d-bdb19c6af137 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received unexpected event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 for instance with vm_state building and task_state spawning.
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:21 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:19:23 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Instance spawned successfully.
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:23 user nova-compute[75206]: INFO nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:23 user nova-compute[75206]: DEBUG nova.compute.manager [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] No waiting events found dispatching network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:19:23 user nova-compute[75206]: WARNING nova.compute.manager [req-454cbd59-8e79-46c6-9507-b3b16f0e8833 req-acbf6c7b-9b44-4a83-ac62-0e3885203f21 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received unexpected event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 for instance with vm_state building and task_state spawning.
Nov 29 22:19:23 user nova-compute[75206]: INFO nova.compute.manager [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Took 13.70 seconds to build instance.
Nov 29 22:19:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-b2328289-1a7c-4bca-8ea1-34a397c91c6e tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.791s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:30 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f is timed out.
Nov 29 22:19:30 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config.
Nov 29 22:19:30 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMUXFAtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:19:30 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c60f5-3bf2-428f-a019-e68438b32f0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:19:30 user nova-compute[75206]: No targets found.
Nov 29 22:19:30 user nova-compute[75206]: iSNS:
Nov 29 22:19:30 user nova-compute[75206]: No targets found.
Nov 29 22:19:30 user nova-compute[75206]: STATIC:
Nov 29 22:19:30 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:19:30 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:19:30 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:19:30 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc
Nov 29 22:19:30 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:19:30 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:19:30 user nova-compute[75206]: FIRMWARE:
Nov 29 22:19:30 user nova-compute[75206]: No targets found.
Nov 29 22:19:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:19:30 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:19:30 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c7498-9be9-45f4-807d-53181fede377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c3e59d-dbb5-4ac3-9c75-5c7c22d2c74b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:30 user nova-compute[75206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:19:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc (non-flash)
Nov 29 22:19:30 user nova-compute[75206]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:19:30 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c8279870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e1f2d-0a54-4409-a980-b5da43013656]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6fdcdf-bb0d-4a77-832b-9d50439f1248]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b691bc54-8608-4fa9-9c45-06a122ddc1e6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:19:30 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098cc4a-dfc6-4b29-9960-8df7eaff8fca]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aaed89-a514-4a1d-ac9c-a441a0603284]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9cdf51-8ce6-4c7f-8dbe-050107d88791]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260]
Nov 29 22:19:31 user nova-compute[75206]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc, portal: 172.16.0.220,3260] successful.
Nov 29 22:19:31 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5be67d47-5653-44dd-8d75-46896a62fddc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41982f5f-7d65-453b-bb54-26cc2f77f904]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== disconnect_volume: return (298ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:19:31 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9107164e-6643-4624-8be6-c7192e71e301 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:19:43 user nova-compute[75206]: INFO nova.compute.claims [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Claim successful on node user
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:19:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.policy [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fec00476dc9c48e589ba6105b5b5cf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edbbd3bc5d74985817fc88839c58e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:19:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Creating image(s)
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "/opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "/opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.194s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk 1073741824 {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212,backing_fmt=raw /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk 1073741824" returned: 0 in 0.047s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "0f75dab7f431c448d2f494f64cf5c73b2b4be212" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:43 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212 --force-share --output=json" returned: 0 in 0.200s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk. size=1073741824 {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Successfully created port: a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.virt.disk.api [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Cannot resize image /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk to a smaller size. {{(pid=75206) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Created local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Ensure instance console log exists: /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Successfully updated port: a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquired lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-changed-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Refreshing instance network info cache due to event network-changed-a2c2a451-a4c1-4c87-a31d-357ed7797bd7. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] Acquiring lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:19:44 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.neutron [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating instance_info_cache with network_info: [{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Releasing lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Instance network_info: |[{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] Acquired lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Refreshing network info cache for port a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Start _get_guest_xml network_info=[{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:19:45 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:45 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T21:41:45Z,direct_url=<?>,disk_format='qcow2',id=e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a10cf012105e4b0dab3cb14558561298',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T21:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1145903298',display_name='tempest-AttachVolumeTestJSON-server-1145903298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1145903298',id=50,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBmyN/8z3OkuKIDmnZW5ByHFtnGCDcqepdwXvQD8Q1vK/8S825gLpsSwwQJElJAZbk2KuXK8/CQb5PPyI0ckB7voQmrJsk5h0zzyOWla1CPeqXGO6nTzYN6hDdmTEWDsg==',key_name='tempest-keypair-230282176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-p07beobr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=2a0f08b0-baac-4640-a533-5b4be46de2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.objects.instance [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:19:45 user nova-compute[75206]:   <uuid>2a0f08b0-baac-4640-a533-5b4be46de2b6</uuid>
Nov 29 22:19:45 user nova-compute[75206]:   <name>instance-00000032</name>
Nov 29 22:19:45 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:19:45 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:19:45 user nova-compute[75206]:   <metadata>
Nov 29 22:19:45 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:19:45 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:name>tempest-AttachVolumeTestJSON-server-1145903298</nova:name>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:19:45</nova:creationTime>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:19:45 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:19:45 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:owner>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:user uuid="fec00476dc9c48e589ba6105b5b5cf7c">tempest-AttachVolumeTestJSON-1138208547-project-member</nova:user>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:project uuid="4edbbd3bc5d74985817fc88839c58e4f">tempest-AttachVolumeTestJSON-1138208547</nova:project>
Nov 29 22:19:45 user nova-compute[75206]:       </nova:owner>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:root type="image" uuid="e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d"/>
Nov 29 22:19:45 user nova-compute[75206]:       <nova:ports>
Nov 29 22:19:45 user nova-compute[75206]:         <nova:port uuid="a2c2a451-a4c1-4c87-a31d-357ed7797bd7">
Nov 29 22:19:45 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 22:19:45 user nova-compute[75206]:         </nova:port>
Nov 29 22:19:45 user nova-compute[75206]:       </nova:ports>
Nov 29 22:19:45 user nova-compute[75206]:     </nova:instance>
Nov 29 22:19:45 user nova-compute[75206]:   </metadata>
Nov 29 22:19:45 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:19:45 user nova-compute[75206]:     <system>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="serial">2a0f08b0-baac-4640-a533-5b4be46de2b6</entry>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="uuid">2a0f08b0-baac-4640-a533-5b4be46de2b6</entry>
Nov 29 22:19:45 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:19:45 user nova-compute[75206]:     </system>
Nov 29 22:19:45 user nova-compute[75206]:   </sysinfo>
Nov 29 22:19:45 user nova-compute[75206]:   <os>
Nov 29 22:19:45 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:19:45 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:19:45 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:19:45 user nova-compute[75206]:   </os>
Nov 29 22:19:45 user nova-compute[75206]:   <features>
Nov 29 22:19:45 user nova-compute[75206]:     <acpi/>
Nov 29 22:19:45 user nova-compute[75206]:     <apic/>
Nov 29 22:19:45 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:19:45 user nova-compute[75206]:   </features>
Nov 29 22:19:45 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:19:45 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:19:45 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:19:45 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:19:45 user nova-compute[75206]:   </clock>
Nov 29 22:19:45 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:19:45 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:19:45 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:19:45 user nova-compute[75206]:   </cpu>
Nov 29 22:19:45 user nova-compute[75206]:   <devices>
Nov 29 22:19:45 user nova-compute[75206]:     <disk type="file" device="disk">
Nov 29 22:19:45 user nova-compute[75206]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 22:19:45 user nova-compute[75206]:       <source file="/opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk"/>
Nov 29 22:19:45 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:19:45 user nova-compute[75206]:     </disk>
Nov 29 22:19:45 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:19:45 user nova-compute[75206]:       <mac address="fa:16:3e:34:ab:7a"/>
Nov 29 22:19:45 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:19:45 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:19:45 user nova-compute[75206]:       <target dev="tapa2c2a451-a4"/>
Nov 29 22:19:45 user nova-compute[75206]:     </interface>
Nov 29 22:19:45 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:19:45 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/console.log" append="off"/>
Nov 29 22:19:45 user nova-compute[75206]:     </serial>
Nov 29 22:19:45 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:19:45 user nova-compute[75206]:     <video>
Nov 29 22:19:45 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:19:45 user nova-compute[75206]:     </video>
Nov 29 22:19:45 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:19:45 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:19:45 user nova-compute[75206]:     </rng>
Nov 29 22:19:45 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:19:45 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:19:45 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:19:45 user nova-compute[75206]:     </memballoon>
Nov 29 22:19:45 user nova-compute[75206]:   </devices>
Nov 29 22:19:45 user nova-compute[75206]: </domain>
Nov 29 22:19:45 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1145903298',display_name='tempest-AttachVolumeTestJSON-server-1145903298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1145903298',id=50,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBmyN/8z3OkuKIDmnZW5ByHFtnGCDcqepdwXvQD8Q1vK/8S825gLpsSwwQJElJAZbk2KuXK8/CQb5PPyI0ckB7voQmrJsk5h0zzyOWla1CPeqXGO6nTzYN6hDdmTEWDsg==',key_name='tempest-keypair-230282176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-p07beobr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=2a0f08b0-baac-4640-a533-5b4be46de2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG os_vif [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '292ce3f6-bfe5-5730-bc94-ce2b60b68198', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2c2a451-a4, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2c2a451-a4, col_values=(('qos', UUID('0fdcfd18-f965-43fd-904e-2ae2b08f87b3')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2c2a451-a4, col_values=(('external_ids', {'iface-id': 'a2c2a451-a4c1-4c87-a31d-357ed7797bd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:ab:7a', 'vm-uuid': '2a0f08b0-baac-4640-a533-5b4be46de2b6'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:45 user nova-compute[75206]: INFO os_vif [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4')
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No VIF found with MAC fa:16:3e:34:ab:7a, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updated VIF entry in instance network info cache for port a2c2a451-a4c1-4c87-a31d-357ed7797bd7. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG nova.network.neutron [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating instance_info_cache with network_info: [{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:19:45 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6971ff82-d567-4e2b-8535-22ab01ae3a72 req-0531006a-3177-4718-9ece-97f54dd99e4c service nova] Releasing lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] No waiting events found dispatching network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:19:46 user nova-compute[75206]: WARNING nova.compute.manager [req-14b88c1b-7467-4e17-85cb-d4ad9e284e4a req-4bc57490-9916-408c-9530-5dff03d38177 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received unexpected event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 for instance with vm_state building and task_state spawning.
Nov 29 22:19:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:19:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Instance spawned successfully.
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:19:48 user nova-compute[75206]: INFO nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 29 22:19:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:19:48 user nova-compute[75206]: INFO nova.compute.manager [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Took 5.98 seconds to build instance.
Nov 29 22:19:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:19:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] No waiting events found dispatching network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:19:49 user nova-compute[75206]: WARNING nova.compute.manager [req-a88c9c4a-6ec0-4266-a3e2-00a2da6058ed req-52dfaf40-1a22-41a8-9f2a-d63bd2c00a76 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received unexpected event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 for instance with vm_state active and task_state None.
Nov 29 22:19:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-45a1231d-dc3f-4d37-af7c-3d429176f2d8 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.077s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [{"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-03750708-8c0e-455e-a83b-5f8ca663c30f" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:19:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=24.95392608642578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:19:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:19:52 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:19:52 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:19:52 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:19:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:19:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:19:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:19:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:19:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:20:03 user nova-compute[75206]: INFO nova.compute.manager [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attaching volume 85f89199-988d-4ba7-b16c-bdad1a7e17ef to /dev/vdb
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64963b1-4a4d-48ef-8ccd-d3efc1c02ae8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[906575c1-eee2-4a50-bbe7-26853b9c4b1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef998d-4b11-45f3-a5ff-83029bddd67f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c071cf-f765-495a-bc76-3fb5befc183c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:20:03 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:20:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7153916-d5cb-45d4-b8ee-f290152f5020]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG os_brick.utils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:20:03 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating existing volume attachment record: 35c10b6c-3106-4acd-93e1-7788b5b17082 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:20:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIrApwKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:20:11 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:20:11 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:20:11 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4220e3-a05a-4141-89b4-072d77845439]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:20:11 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1300a31-ff55-4df8-aa86-3e02e4a51fd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef] added
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[568cf1e1-552c-44ba-b638-6dc80bcef535]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f15fd-3ac8-4176-9b93-ee1e6f98386f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIrApwKG {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIrApwKG" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6536e-adbf-4fe9-88fb-88d42794af30]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIrApwKG'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cc224c-93dd-4054-a939-4ba6daac8da8]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df264714-2dcd-426a-b3a6-0d50ffac0ef7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0427a20a-fbae-41cd-b263-3e8797543254]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260]
Nov 29 22:20:11 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1747bd1-b7b2-4b05-afa6-3dcfddbd21ad]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa7f8a-04ef-4b4d-8b49-b2a537348af3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)
Nov 29 22:20:11 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f2a61-4e14-4e6b-b1fc-bf95bd087600]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:20:11 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIrApwKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23531636538663162', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531636538663162', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG nova.objects.instance [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:20:12 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:20:12 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:20:12 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:20:12 user nova-compute[75206]:   <serial>85f89199-988d-4ba7-b16c-bdad1a7e17ef</serial>
Nov 29 22:20:12 user nova-compute[75206]: </disk>
Nov 29 22:20:12 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:20:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:20:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:20:13 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No VIF found with MAC fa:16:3e:81:26:f8, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:20:13 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-3120d18e-bfef-4485-b082-dc21f914d805 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.676s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:20:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:20:15 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:20:15 user nova-compute[75206]: INFO nova.compute.manager [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Detaching volume 85f89199-988d-4ba7-b16c-bdad1a7e17ef
Nov 29 22:20:15 user nova-compute[75206]: INFO nova.virt.block_device [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attempting to driver detach volume 85f89199-988d-4ba7-b16c-bdad1a7e17ef from mountpoint /dev/vdb
Nov 29 22:20:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Attempting to detach device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:20:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:20:15 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:20:15 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:20:15 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:20:15 user nova-compute[75206]:   <serial>85f89199-988d-4ba7-b16c-bdad1a7e17ef</serial>
Nov 29 22:20:15 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:20:15 user nova-compute[75206]: </disk>
Nov 29 22:20:15 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:20:15 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config.
Nov 29 22:20:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:20:15 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:20:15 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:20:15 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:20:15 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:20:15 user nova-compute[75206]:   <serial>85f89199-988d-4ba7-b16c-bdad1a7e17ef</serial>
Nov 29 22:20:15 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:20:15 user nova-compute[75206]: </disk>
Nov 29 22:20:15 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:20:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:20:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:36 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f is timed out.
Nov 29 22:20:36 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config.
Nov 29 22:20:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIrApwKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:20:36 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da39361-2370-4c25-b3fb-c9b4e199f09f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:20:36 user nova-compute[75206]: No targets found.
Nov 29 22:20:36 user nova-compute[75206]: iSNS:
Nov 29 22:20:36 user nova-compute[75206]: No targets found.
Nov 29 22:20:36 user nova-compute[75206]: STATIC:
Nov 29 22:20:36 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef
Nov 29 22:20:36 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:20:36 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:20:36 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:20:36 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:20:36 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:20:36 user nova-compute[75206]: FIRMWARE:
Nov 29 22:20:36 user nova-compute[75206]: No targets found.
Nov 29 22:20:36 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:20:36 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:20:36 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcbea22-e640-4f2a-a3e6-076c24a3160d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a243eea-6c9d-44f1-bbd1-f6c385e06bdf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:36 user nova-compute[75206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)
Nov 29 22:20:36 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:20:36 user nova-compute[75206]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef (non-flash)
Nov 29 22:20:36 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498682560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaec67c-f05b-4ad1-82a3-da1a93aef4d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07de40-fc90-4f3b-9592-a51096157cde]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c522a-35b2-4197-aaac-b7f80f63a0fa]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b8222-4c61-45a6-bf3b-61320ce364f6]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68801dc-a3e4-41a9-b449-6338d8e10882]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74aebe-44e2-437e-9375-f62a0d99a74b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260]
Nov 29 22:20:36 user nova-compute[75206]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:20:36 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f89199-988d-4ba7-b16c-bdad1a7e17ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55106139-76e8-4330-843c-5ce022e4b85e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== disconnect_volume: return (282ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:20:36 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:20:37 user nova-compute[75206]: DEBUG nova.objects.instance [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:20:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-96db59f4-ba5e-4df9-9e41-3e063f7201cf tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:20:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:20:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:20:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:20:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:20:51 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=24.925079345703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:20:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating instance_info_cache with network_info: [{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:20:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:20:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:20:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:20:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:20:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-changed-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG nova.compute.manager [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Refreshing instance network info cache due to event network-changed-93a663e7-e847-4bf2-85e4-cfd55ecd0368. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] Acquiring lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] Acquired lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Refreshing network info cache for port 93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updated VIF entry in instance network info cache for port 93a663e7-e847-4bf2-85e4-cfd55ecd0368. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG nova.network.neutron [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating instance_info_cache with network_info: [{"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:01 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-2f7532ae-70df-4a0f-b590-29db05e0171b req-90bff10a-7eff-4486-abf2-e2d4fa4ac956 service nova] Releasing lock "refresh_cache-10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:21:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:03 user nova-compute[75206]: INFO nova.compute.manager [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Terminating instance
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-unplugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] No waiting events found dispatching network-vif-unplugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-unplugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Acquiring lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] No waiting events found dispatching network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:21:03 user nova-compute[75206]: WARNING nova.compute.manager [req-c7305ea8-215b-4898-a7ef-dd35651b1a7e req-a148814a-84a4-4709-ade7-55dde05d17e1 service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received unexpected event network-vif-plugged-93a663e7-e847-4bf2-85e4-cfd55ecd0368 for instance with vm_state active and task_state deleting.
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Instance destroyed successfully.
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.objects.instance [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1011851678',display_name='tempest-TestVolumeBootPattern-server-1011851678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1011851678',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-v4f703hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:19:23Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=10b5c2ca-2d45-4b9f-8221-77622b3d7e2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "address": "fa:16:3e:61:6e:93", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a663e7-e8", "ovs_interfaceid": "93a663e7-e847-4bf2-85e4-cfd55ecd0368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_vif [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93a663e7-e8, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02505c83-e330-4df7-afce-bfa048efcd40) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:21:03 user nova-compute[75206]: INFO os_vif [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6e:93,bridge_name='br-int',has_traffic_filtering=True,id=93a663e7-e847-4bf2-85e4-cfd55ecd0368,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a663e7-e8')
Nov 29 22:21:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ddd1fb-07fa-4565-9d6c-e46137408e59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:21:03 user nova-compute[75206]: No targets found.
Nov 29 22:21:03 user nova-compute[75206]: iSNS:
Nov 29 22:21:03 user nova-compute[75206]: No targets found.
Nov 29 22:21:03 user nova-compute[75206]: STATIC:
Nov 29 22:21:03 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:21:03 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:21:03 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:21:03 user nova-compute[75206]: FIRMWARE:
Nov 29 22:21:03 user nova-compute[75206]: No targets found.
Nov 29 22:21:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:21:03 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:21:03 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc43dbe-1d65-42d6-bba1-d48a0ab13bcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2555f21-4eb4-4a3e-8656-eac51de628a7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:21:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:21:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b84645e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[84167969-2015-4e66-a624-be2076f898de]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e848d3cb-b03e-4899-bca2-272de9078c38]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ea88d-ce3f-4696-bed6-e0a831f6cb4b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e07ffb2-1ed0-42e2-9ded-c1dbcbc55ccf]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc48563e0-e9f78f06f97c5a8f', '/dev/disk/by-id/scsi-26539663738663036', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c48563e0') {{(pid=85661) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93f17d-f912-4f09-b2cc-eb12208f8aa2]: (4, None) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cc9803-9aa1-463b-b648-391f89e293f6]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[098c8366-cb48-426c-8f8e-433626fe9ea9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]
Nov 29 22:21:04 user nova-compute[75206]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:21:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd73d1-9a56-4ac4-acb4-af5d03c2617e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (279ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:21:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Deleting instance files /opt/stack/data/nova/instances/10b5c2ca-2d45-4b9f-8221-77622b3d7e2b_del
Nov 29 22:21:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Deletion of /opt/stack/data/nova/instances/10b5c2ca-2d45-4b9f-8221-77622b3d7e2b_del complete
Nov 29 22:21:04 user nova-compute[75206]: INFO nova.compute.manager [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 29 22:21:04 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:21:04 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:04 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Took 0.71 seconds to deallocate network for instance.
Nov 29 22:21:05 user nova-compute[75206]: DEBUG nova.compute.manager [req-c835152f-c725-4f78-b994-b9963d28b992 req-d3c5a3ba-ec59-4096-9ef2-223a73d757ca service nova] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Received event network-vif-deleted-93a663e7-e847-4bf2-85e4-cfd55ecd0368 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:05 user nova-compute[75206]: INFO nova.compute.manager [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b] Took 1.10 seconds to detach 1 volumes for instance.
Nov 29 22:21:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:06 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:21:06 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:21:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:06 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance 10b5c2ca-2d45-4b9f-8221-77622b3d7e2b
Nov 29 22:21:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-1f73aae2-ceae-4980-a845-fab3cad29b26 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "10b5c2ca-2d45-4b9f-8221-77622b3d7e2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG nova.objects.instance [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:09 user nova-compute[75206]: INFO nova.compute.manager [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attaching volume 8a0099fa-583e-4f5d-ba73-453b570b4978 to /dev/vdb
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.utils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8dd585-e037-490f-836c-798c254ae13b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c514cfa9-fd27-4f18-bd09-d8ecd93ce242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666702a-7024-49f3-93d4-54552ca8b2ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688e762-12bb-4b4b-b6d4-4aa38435b78c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:09 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:21:09 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad98626-60a1-47c2-959b-9859abd234f1]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG os_brick.utils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:09 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating existing volume attachment record: c51802d8-c803-4b65-b262-e48d17759f50 {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:21:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Verify base images {{(pid=75206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Image id e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d yields fingerprint 0f75dab7f431c448d2f494f64cf5c73b2b4be212 {{(pid=75206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] image e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d at (/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212): checking
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] image e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d at (/opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212): image is in use {{(pid=75206) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] 2a0f08b0-baac-4640-a533-5b4be46de2b6 is a valid instance name {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] 2a0f08b0-baac-4640-a533-5b4be46de2b6 has a disk file {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 is backed by 0f75dab7f431c448d2f494f64cf5c73b2b4be212 {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] 03750708-8c0e-455e-a83b-5f8ca663c30f is a valid instance name {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] 03750708-8c0e-455e-a83b-5f8ca663c30f has a disk file {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f is backed by 0f75dab7f431c448d2f494f64cf5c73b2b4be212 {{(pid=75206) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4
Nov 29 22:21:16 user nova-compute[75206]: WARNING nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Unknown base file: /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Active base files: /opt/stack/data/nova/instances/_base/0f75dab7f431c448d2f494f64cf5c73b2b4be212
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Removable base files: /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10 /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111 /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3 /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4 /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d86fc8487adab838be3f1e99af85305db917050b
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2220e19d129301ac46ab1973392427787abc2d10
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cbebf6538616e4ac57801d1774e8238df0117111
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/78ac238f0dbaeea9032334f6033749273481fe9e
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/142d33025bc4e6504cd8767e07802f3915fc8e7b
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db6d80d286c3af0cfb398368f1145e4ca565121c
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b67a7a018931b2b29eb0d9aa38c57f7efc6915e3
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b4b1be8bf6562aea7579714b9d445823bb3d11c4
Nov 29 22:21:16 user nova-compute[75206]: INFO nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/729b36eaec06c3e58d053dd52ed3bcfc85f1e85a
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Verification complete {{(pid=75206) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Verify swap images {{(pid=75206) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.imagecache [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Verify ephemeral images {{(pid=75206) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWCGjBOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:16 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:16 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:16 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5133a-6dcb-4ad7-97c6-9a530dc867ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:21:16 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d52f1-88cd-468d-8caa-a70837f407f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978] added
Nov 29 22:21:16 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ef128-135a-4549-afac-6fcc43dee54f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b60587-4a53-4440-b368-be186303d263]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWCGjBOn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWCGjBOn" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7354d405-27f4-429a-9642-f393855c8210]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWCGjBOn'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:16 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a798b6-6d3d-435f-b37b-e9eecc39e189]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b4e00c-f620-46a1-bca6-23ab8c6c1c6c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:21:17 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:21:17 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:17 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 22:21:17 user nova-compute[75206]: 
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6060e5-52ff-445d-81a7-64920c8d829f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260]
Nov 29 22:21:17 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260] successful.
Nov 29 22:21:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a480f-f75e-4246-b542-b1228068fc10]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c59843-7d0a-4bcf-8a6b-eb7d9c3c6605]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)
Nov 29 22:21:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)
Nov 29 22:21:17 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c857892a-b2f2-45c7-893a-240e0e3ed1cb]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:21:17 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWCGjBOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26162626563343535', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162626563343535', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.objects.instance [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:21:18 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:21:18 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:21:18 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:21:18 user nova-compute[75206]:   <serial>8a0099fa-583e-4f5d-ba73-453b570b4978</serial>
Nov 29 22:21:18 user nova-compute[75206]: </disk>
Nov 29 22:21:18 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] No VIF found with MAC fa:16:3e:81:26:f8, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:21:18 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-892f1cb1-54c1-497d-bd14-5d22619f4d70 tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.619s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:21 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:21 user nova-compute[75206]: INFO nova.compute.manager [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Detaching volume 8a0099fa-583e-4f5d-ba73-453b570b4978
Nov 29 22:21:21 user nova-compute[75206]: INFO nova.virt.block_device [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Attempting to driver detach volume 8a0099fa-583e-4f5d-ba73-453b570b4978 from mountpoint /dev/vdb
Nov 29 22:21:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Attempting to detach device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:21:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:21:21 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:21:21 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:21:21 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:21:21 user nova-compute[75206]:   <serial>8a0099fa-583e-4f5d-ba73-453b570b4978</serial>
Nov 29 22:21:21 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:21:21 user nova-compute[75206]: </disk>
Nov 29 22:21:21 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:21:21 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the persistent domain config.
Nov 29 22:21:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:21:21 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:21:21 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:21:21 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:21:21 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:21:21 user nova-compute[75206]:   <serial>8a0099fa-583e-4f5d-ba73-453b570b4978</serial>
Nov 29 22:21:21 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:21:21 user nova-compute[75206]: </disk>
Nov 29 22:21:21 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:21:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:21:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-changed-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG nova.compute.manager [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Refreshing instance network info cache due to event network-changed-a2c2a451-a4c1-4c87-a31d-357ed7797bd7. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] Acquiring lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] Acquired lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Refreshing network info cache for port a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updated VIF entry in instance network info cache for port a2c2a451-a4c1-4c87-a31d-357ed7797bd7. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG nova.network.neutron [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating instance_info_cache with network_info: [{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:34 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9c8fc151-1a9f-4c72-a1c8-28e4be542bdc req-f31a2024-7236-4732-90a9-b1c5639357bb service nova] Releasing lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:21:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:36 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:36 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:37 user nova-compute[75206]: INFO nova.compute.manager [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attaching volume 288cb784-42b4-4af8-baff-272b8679a968 to /dev/vdb
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.utils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc2e2f-5160-4b1b-94c8-c52e914e10d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[960d7390-3c0e-46c9-959c-39f905ced07d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ffe9a-fc4d-4cf0-a11d-6816a214d6e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe06ba-3cab-4a7b-b507-801eb727ca16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:37 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:21:37 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e2d0f-30dc-46f3-8fbc-27cc8a5a5ef0]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG os_brick.utils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating existing volume attachment record: c3b357db-7902-49bb-910c-b7477c36845f {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:21:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:42 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03750708-8c0e-455e-a83b-5f8ca663c30f is timed out.
Nov 29 22:21:42 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully detached device vdb from instance 03750708-8c0e-455e-a83b-5f8ca663c30f from the live domain config.
Nov 29 22:21:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWCGjBOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:42 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51b3e7-ec17-4652-8536-aafe04ffd7f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:21:42 user nova-compute[75206]: No targets found.
Nov 29 22:21:42 user nova-compute[75206]: iSNS:
Nov 29 22:21:42 user nova-compute[75206]: No targets found.
Nov 29 22:21:42 user nova-compute[75206]: STATIC:
Nov 29 22:21:42 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978
Nov 29 22:21:42 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:21:42 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:21:42 user nova-compute[75206]: FIRMWARE:
Nov 29 22:21:42 user nova-compute[75206]: No targets found.
Nov 29 22:21:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:21:42 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:21:42 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b518225-01a1-45c3-9f21-96381029c1b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea70ee8-2f33-471e-8398-119d67572dbf]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)
Nov 29 22:21:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 (non-flash)
Nov 29 22:21:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498616ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae497d-669c-41f2-ad9e-375d19b41b36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fb9d4a-3800-4533-beb5-8fbf29943bb6]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5b6267-ebb0-4d87-9f09-f0eeff4c5bc0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c23ee8-875d-4767-a8c8-6de2d0d2235e]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b234306-1b08-4059-ab44-a5b2b47583c0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[853258ad-44f0-4628-b871-e08f88d25c40]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260]
Nov 29 22:21:42 user nova-compute[75206]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978, portal: 172.16.0.220,3260] successful.
Nov 29 22:21:42 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0099fa-583e-4f5d-ba73-453b570b4978 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba6ead-9a8c-42a2-8d67-c55bc31ee359]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] <== disconnect_volume: return (292ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:21:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'flavor' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:43 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-29955952-d9e9-4c6c-bdaa-e05e3f46d61d tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFDZdwjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:45 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf91541b-79ee-4510-8c32-cccc886e2763]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:21:45 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d030a-b805-4f76-ac20-732eaaa18ebf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968] added
Nov 29 22:21:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefd878c-9d87-42df-9273-3ccbf44dad3b]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3c31e-a94b-4b90-9c33-2ba01da2ea06]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFDZdwjv {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFDZdwjv" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d9c4a-7142-486c-a9b7-0ea9c75173de]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFDZdwjv'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e363fb-08df-48b8-8a99-52a6b932958d]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ed4f7d-6c62-46f3-8a55-40b2c6109ff4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:21:45 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 22:21:45 user nova-compute[75206]:  {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 22:21:45 user nova-compute[75206]: 
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bdda9a-4c5b-4d11-8df6-b7dc185d5fa4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260]
Nov 29 22:21:45 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260] successful.
Nov 29 22:21:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e23a0a-9411-41ef-8779-f9f144d865b7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[add097ca-94bb-45e6-b03a-b7ff784b980f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea4d35-4f21-4b3a-814d-f95b784f992d]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:21:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFDZdwjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23064396134376266', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064396134376266', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.objects.instance [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:21:46 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:21:46 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:21:46 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:21:46 user nova-compute[75206]:   <serial>288cb784-42b4-4af8-baff-272b8679a968</serial>
Nov 29 22:21:46 user nova-compute[75206]: </disk>
Nov 29 22:21:46 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No VIF found with MAC fa:16:3e:34:ab:7a, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:21:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-5e320ea1-f448-4362-abc3-46f6ab7e1152 tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.801s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:47 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:50 user nova-compute[75206]: INFO nova.compute.manager [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attaching volume a22c4125-857e-4442-9018-9a4ca26cd254 to /dev/vdc
Nov 29 22:21:50 user nova-compute[75206]: DEBUG os_brick.utils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a21e62e-4f20-4aaf-9c73-e4cbdd0ea7ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:50 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b6c0e-8ba2-43e4-81d0-5e84c6d6bb24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ce38a-e206-47b2-b4cb-3540138557ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce2d787-ad09-46f0-b5c8-8f1a63cff6ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:51 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:21:51 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7219803e-2491-4986-b8a2-bb944d011eaf]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG os_brick.utils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:51 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating existing volume attachment record: 4bbb29a5-94de-4d2c-a139-888521efb84d {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating instance_info_cache with network_info: [{"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-2a0f08b0-baac-4640-a533-5b4be46de2b6" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:52 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:21:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:21:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=24.91529083251953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 03750708-8c0e-455e-a83b-5f8ca663c30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:21:54 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:21:54 user nova-compute[75206]: INFO nova.compute.claims [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Claim successful on node user
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:21:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.policy [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:21:55 user nova-compute[75206]: INFO nova.virt.block_device [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Booting with volume 3a89b249-1376-457e-ac6f-0cdd073175ef at /dev/vda
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b96b4cd-187a-4e4c-bb96-d17532aa9f55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc0714-f04f-4762-b541-e34da84ba75b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4eb3c6-6eb8-4258-ae71-e89c7fddd68b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[adedf904-5d2f-4080-9f14-22f15202741d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:21:55 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:21:55 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29c219-3b1f-4c66-8471-a521ae265ce8]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating existing volume attachment record: 2b717693-9828-4b27-bb43-bdef1e49453a {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:21:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Successfully created port: 7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Successfully updated port: 7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.compute.manager [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing instance network info cache due to event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:21:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Instance network_info: |[{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated VIF entry in instance network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:21:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-6cd01226-e815-4391-b333-c05aa45b638e req-c54c2fc2-34cf-4ae9-8d37-f6bb8df312b3 service nova] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:21:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:21:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWfcdvgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:21:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:59 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:21:59 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9406744e-6fe1-41fb-90cd-3aca3400cc3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:21:59 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[db536e86-796e-4676-bee0-d538190d146b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254] added
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f461be-b942-4801-b4af-11c9f98276cd]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba54104-9676-471e-b786-2a8fa3dd9b36]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWfcdvgE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWfcdvgE" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1ce8d-9b95-4440-88e8-634ef3882506]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWfcdvgE'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc77439-e27d-4ef0-aca7-05bfc49e7ed7]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa0805-e8e7-460f-ae51-0c6e22dc34c5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[433408bd-8f70-424b-ade7-29ac05a0bd3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260]
Nov 29 22:21:59 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260] successful.
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c58ab15-59b2-4bf7-9a34-a7846732ffd0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[842368c2-e325-4581-b3f3-5aba1ea8fe28]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:21:59 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a2674-3e2b-45a1-ab28-cb80bca6f4a7]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:21:59 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWfcdvgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23138643032373337', 'path': '/dev/sdc'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138643032373337', 'path': '/dev/sdc'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.objects.instance [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 22:22:00 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:00 user nova-compute[75206]:   <source dev="/dev/sdc"/>
Nov 29 22:22:00 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:22:00 user nova-compute[75206]:   <serial>a22c4125-857e-4442-9018-9a4ca26cd254</serial>
Nov 29 22:22:00 user nova-compute[75206]: </disk>
Nov 29 22:22:00 user nova-compute[75206]:  {{(pid=75206) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] No VIF found with MAC fa:16:3e:34:ab:7a, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:22:00 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-a5c949d9-08f6-4fdc-8647-4a93abe17e6c tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.077s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:02 user nova-compute[75206]: INFO nova.compute.manager [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Detaching volume 288cb784-42b4-4af8-baff-272b8679a968
Nov 29 22:22:02 user nova-compute[75206]: INFO nova.virt.block_device [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attempting to driver detach volume 288cb784-42b4-4af8-baff-272b8679a968 from mountpoint /dev/vdb
Nov 29 22:22:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Attempting to detach device vdb from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:22:02 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:02 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:22:02 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:22:02 user nova-compute[75206]:   <serial>288cb784-42b4-4af8-baff-272b8679a968</serial>
Nov 29 22:22:02 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:22:02 user nova-compute[75206]: </disk>
Nov 29 22:22:02 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:22:02 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdb from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the persistent domain config.
Nov 29 22:22:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:22:02 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:02 user nova-compute[75206]:   <source dev="/dev/sdb"/>
Nov 29 22:22:02 user nova-compute[75206]:   <target dev="vdb" bus="virtio"/>
Nov 29 22:22:02 user nova-compute[75206]:   <serial>288cb784-42b4-4af8-baff-272b8679a968</serial>
Nov 29 22:22:02 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 22:22:02 user nova-compute[75206]: </disk>
Nov 29 22:22:02 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:22:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:22:03 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Creating image(s)
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Ensure instance console log exists: /opt/stack/data/nova/instances/3b7fff54-97a3-4b9a-80fb-c77cfc279772/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Start _get_guest_xml network_info=[{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '2b717693-9828-4b27-bb43-bdef1e49453a', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b7fff54-97a3-4b9a-80fb-c77cfc279772', 'attached_at': '', 'detached_at': '', 'volume_id': '3a89b249-1376-457e-ac6f-0cdd073175ef', 'serial': '3a89b249-1376-457e-ac6f-0cdd073175ef'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:22:03 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:22:03 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:22:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:22:03 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:22:03 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9e2f8-5351-4431-a8b3-fec4ae140c79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:22:03 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[068ee1d0-82c0-438d-83c5-4911e87876b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef] added
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994346c-357e-4aba-9427-450376e93aed]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e04750-3bc6-46c4-8091-802e31ae1dd0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTzSJWxr {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTzSJWxr" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64300846-2295-494d-bf0f-ba7431d49175]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTzSJWxr'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5651920a-3d4c-4e8d-92a3-fd06eeac0619]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556e9fe-e134-476e-a360-7437b8160f71]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3bd3c-5e62-4875-9a23-be816008aa10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]
Nov 29 22:22:03 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b61857-4ac2-4813-ae5d-917ebcad1415]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe5365-7ad2-40ed-9993-f4c2c8983b7f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:03 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:03 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[af052092-e447-494d-8d43-25e2a7aa35d1]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:22:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26539663738663036', 'path': '/dev/sdd'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539663738663036', 'path': '/dev/sdd'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1255557720',display_name='tempest-TestVolumeBootPattern-server-1255557720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1255557720',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-60zne9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:21:55Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=3b7fff54-97a3-4b9a-80fb-c77cfc279772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.objects.instance [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:22:04 user nova-compute[75206]:   <uuid>3b7fff54-97a3-4b9a-80fb-c77cfc279772</uuid>
Nov 29 22:22:04 user nova-compute[75206]:   <name>instance-00000033</name>
Nov 29 22:22:04 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:22:04 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:22:04 user nova-compute[75206]:   <metadata>
Nov 29 22:22:04 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:22:04 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:22:04 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-server-1255557720</nova:name>
Nov 29 22:22:04 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:22:03</nova:creationTime>
Nov 29 22:22:04 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:22:04 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:22:04 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:22:04 user nova-compute[75206]:       <nova:owner>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:22:04 user nova-compute[75206]:       </nova:owner>
Nov 29 22:22:04 user nova-compute[75206]:       <nova:ports>
Nov 29 22:22:04 user nova-compute[75206]:         <nova:port uuid="7f082237-ced2-40ad-9f5a-927f43b15766">
Nov 29 22:22:04 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 22:22:04 user nova-compute[75206]:         </nova:port>
Nov 29 22:22:04 user nova-compute[75206]:       </nova:ports>
Nov 29 22:22:04 user nova-compute[75206]:     </nova:instance>
Nov 29 22:22:04 user nova-compute[75206]:   </metadata>
Nov 29 22:22:04 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:22:04 user nova-compute[75206]:     <system>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="serial">3b7fff54-97a3-4b9a-80fb-c77cfc279772</entry>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="uuid">3b7fff54-97a3-4b9a-80fb-c77cfc279772</entry>
Nov 29 22:22:04 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:22:04 user nova-compute[75206]:     </system>
Nov 29 22:22:04 user nova-compute[75206]:   </sysinfo>
Nov 29 22:22:04 user nova-compute[75206]:   <os>
Nov 29 22:22:04 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:22:04 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:22:04 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:22:04 user nova-compute[75206]:   </os>
Nov 29 22:22:04 user nova-compute[75206]:   <features>
Nov 29 22:22:04 user nova-compute[75206]:     <acpi/>
Nov 29 22:22:04 user nova-compute[75206]:     <apic/>
Nov 29 22:22:04 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:22:04 user nova-compute[75206]:   </features>
Nov 29 22:22:04 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:22:04 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:22:04 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:22:04 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:22:04 user nova-compute[75206]:   </clock>
Nov 29 22:22:04 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:22:04 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:22:04 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:22:04 user nova-compute[75206]:   </cpu>
Nov 29 22:22:04 user nova-compute[75206]:   <devices>
Nov 29 22:22:04 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:22:04 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:04 user nova-compute[75206]:       <source dev="/dev/sdd"/>
Nov 29 22:22:04 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:22:04 user nova-compute[75206]:       <serial>3a89b249-1376-457e-ac6f-0cdd073175ef</serial>
Nov 29 22:22:04 user nova-compute[75206]:     </disk>
Nov 29 22:22:04 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:22:04 user nova-compute[75206]:       <mac address="fa:16:3e:d4:96:9c"/>
Nov 29 22:22:04 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:22:04 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:22:04 user nova-compute[75206]:       <target dev="tap7f082237-ce"/>
Nov 29 22:22:04 user nova-compute[75206]:     </interface>
Nov 29 22:22:04 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:22:04 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/3b7fff54-97a3-4b9a-80fb-c77cfc279772/console.log" append="off"/>
Nov 29 22:22:04 user nova-compute[75206]:     </serial>
Nov 29 22:22:04 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:22:04 user nova-compute[75206]:     <video>
Nov 29 22:22:04 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:22:04 user nova-compute[75206]:     </video>
Nov 29 22:22:04 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:22:04 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:22:04 user nova-compute[75206]:     </rng>
Nov 29 22:22:04 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:22:04 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:22:04 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:22:04 user nova-compute[75206]:     </memballoon>
Nov 29 22:22:04 user nova-compute[75206]:   </devices>
Nov 29 22:22:04 user nova-compute[75206]: </domain>
Nov 29 22:22:04 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1255557720',display_name='tempest-TestVolumeBootPattern-server-1255557720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1255557720',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-60zne9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:21:55Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=3b7fff54-97a3-4b9a-80fb-c77cfc279772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG os_vif [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aeb0bd89-102f-57aa-a8d4-8f63734904aa', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f082237-ce, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f082237-ce, col_values=(('qos', UUID('bae1a9c0-32cd-44a8-bc8b-d7dab336086a')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f082237-ce, col_values=(('external_ids', {'iface-id': '7f082237-ced2-40ad-9f5a-927f43b15766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:96:9c', 'vm-uuid': '3b7fff54-97a3-4b9a-80fb-c77cfc279772'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:04 user nova-compute[75206]: INFO os_vif [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce')
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:22:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:d4:96:9c, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG nova.compute.manager [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] No waiting events found dispatching network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:06 user nova-compute[75206]: WARNING nova.compute.manager [req-a50169c6-4745-4c3f-bb67-703ecf05ac1d req-b5471f00-dfad-4f9b-b3f8-f74e2974287e service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received unexpected event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 for instance with vm_state building and task_state spawning.
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:22:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Instance spawned successfully.
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:22:08 user nova-compute[75206]: INFO nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:22:08 user nova-compute[75206]: INFO nova.compute.manager [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Took 13.67 seconds to build instance.
Nov 29 22:22:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-9f54ea9b-0542-4eed-8319-6c0b8a99321d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.763s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:08 user nova-compute[75206]: DEBUG nova.compute.manager [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] No waiting events found dispatching network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:08 user nova-compute[75206]: WARNING nova.compute.manager [req-c3486249-c5db-4f16-91ce-efa7ad8db05e req-c7e01c41-0d90-45cb-8872-0c5d68710464 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received unexpected event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 for instance with vm_state active and task_state None.
Nov 29 22:22:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:12 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:22:12 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:22:12 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:12 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:22 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 is timed out.
Nov 29 22:22:22 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdb from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the live domain config.
Nov 29 22:22:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFDZdwjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:22:22 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d76df30-30b7-491d-86b5-607ea01b8150]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:22:22 user nova-compute[75206]: No targets found.
Nov 29 22:22:22 user nova-compute[75206]: iSNS:
Nov 29 22:22:22 user nova-compute[75206]: No targets found.
Nov 29 22:22:22 user nova-compute[75206]: STATIC:
Nov 29 22:22:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:22:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:22:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:22:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254
Nov 29 22:22:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:22:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:22:22 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968
Nov 29 22:22:22 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:22:22 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:22:22 user nova-compute[75206]: FIRMWARE:
Nov 29 22:22:22 user nova-compute[75206]: No targets found.
Nov 29 22:22:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:22:22 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:22:22 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c7719-7ab3-49b3-914e-dfd2172f3ff1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b571390-e746-413c-aaf0-08bc61b55110]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:22 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:22 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 (non-flash)
Nov 29 22:22:22 user nova-compute[75206]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:22 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498616d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ee2a9-12bc-4de6-a8ef-df5b05c4715b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e354d-e593-4437-a580-bdd42455e177]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f08e8-6d96-4e80-ad97-8813a18e2833]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d06620-2c35-4818-9f35-504d19e343a1]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a0995-d37f-462a-a7ea-9afd1e6b5eba]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dfdecb-2b3c-4a19-b5d7-f0e8f29ae65f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260]
Nov 29 22:22:22 user nova-compute[75206]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968, portal: 172.16.0.220,3260] successful.
Nov 29 22:22:22 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:288cb784-42b4-4af8-baff-272b8679a968 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d9ce5-7481-46ac-af3a-613bcc700f2a]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== disconnect_volume: return (295ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:22:22 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:22:23 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:23 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0f197541-0ba7-48a5-8f90-dc8feb81762f tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.775s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:24 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:24 user nova-compute[75206]: INFO nova.compute.manager [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Detaching volume a22c4125-857e-4442-9018-9a4ca26cd254
Nov 29 22:22:24 user nova-compute[75206]: INFO nova.virt.block_device [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Attempting to driver detach volume a22c4125-857e-4442-9018-9a4ca26cd254 from mountpoint /dev/vdc
Nov 29 22:22:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Attempting to detach device vdc from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the persistent domain config. {{(pid=75206) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 22:22:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:22:24 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:24 user nova-compute[75206]:   <source dev="/dev/sdc"/>
Nov 29 22:22:24 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:22:24 user nova-compute[75206]:   <serial>a22c4125-857e-4442-9018-9a4ca26cd254</serial>
Nov 29 22:22:24 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 22:22:24 user nova-compute[75206]: </disk>
Nov 29 22:22:24 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:22:24 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdc from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the persistent domain config.
Nov 29 22:22:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the live domain config. {{(pid=75206) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 22:22:24 user nova-compute[75206]: DEBUG nova.virt.libvirt.guest [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 22:22:24 user nova-compute[75206]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:22:24 user nova-compute[75206]:   <source dev="/dev/sdc"/>
Nov 29 22:22:24 user nova-compute[75206]:   <target dev="vdc" bus="virtio"/>
Nov 29 22:22:24 user nova-compute[75206]:   <serial>a22c4125-857e-4442-9018-9a4ca26cd254</serial>
Nov 29 22:22:24 user nova-compute[75206]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 22:22:24 user nova-compute[75206]: </disk>
Nov 29 22:22:24 user nova-compute[75206]:  {{(pid=75206) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 22:22:25 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 22:22:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Triggering sync for uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:30 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:42 user nova-compute[75206]: INFO nova.compute.manager [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Terminating instance
Nov 29 22:22:42 user nova-compute[75206]: DEBUG nova.compute.manager [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:42 user nova-compute[75206]: DEBUG nova.compute.manager [req-cf4b5214-4a45-44bb-a6dd-a692ecff2190 req-bca84385-92d5-4ced-b16f-fef2bf443b59 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Instance destroyed successfully.
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.objects.instance [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lazy-loading 'resources' on Instance uuid 03750708-8c0e-455e-a83b-5f8ca663c30f {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-80726617',display_name='tempest-SnapshotDataIntegrityTests-server-80726617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-80726617',id=48,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfvShyayNYXPtxnKI+5A7ILj+deO+bHMrcLjR1OnGeqmtybVH87vMlDDXnJTUy3rUp0e8F0xr2TCRVuaTgFQatBrkHNV4RygpeRiISznszlu//zMI2A4Q8L8YwHexhQEg==',key_name='tempest-keypair-1489884089',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:15:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de5dd143a5d4591b2d04774762c266e',ramdisk_id='',reservation_id='r-cfl856ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2032178691',owner_user_name='tempest-SnapshotDataIntegrityTests-2032178691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64efc46bfe804e7ab7f681153f8302c8',uuid=03750708-8c0e-455e-a83b-5f8ca663c30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converting VIF {"id": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "address": "fa:16:3e:81:26:f8", "network": {"id": "f6ec9b56-f8b0-4cf2-acb3-67b91d261eee", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1957293933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de5dd143a5d4591b2d04774762c266e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb183fab9-60", "ovs_interfaceid": "b183fab9-60ca-4bcd-bbf2-28aee7faca2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG os_vif [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb183fab9-60, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c639148-3bd0-4155-af76-56b4d20cafdf) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: INFO os_vif [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:26:f8,bridge_name='br-int',has_traffic_filtering=True,id=b183fab9-60ca-4bcd-bbf2-28aee7faca2f,network=Network(f6ec9b56-f8b0-4cf2-acb3-67b91d261eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb183fab9-60')
Nov 29 22:22:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Deleting instance files /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f_del
Nov 29 22:22:43 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Deletion of /opt/stack/data/nova/instances/03750708-8c0e-455e-a83b-5f8ca663c30f_del complete
Nov 29 22:22:43 user nova-compute[75206]: INFO nova.compute.manager [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 22:22:43 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:22:44 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Took 0.75 seconds to deallocate network for instance.
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-a5f4bf91-346f-4c96-af35-cf971af3e1fc req-46062f21-94c4-434a-9e5d-8c76a45ca84b service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-deleted-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.639s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:44 user nova-compute[75206]: WARNING nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state deleted and task_state None.
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:44 user nova-compute[75206]: WARNING nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state deleted and task_state None.
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:44 user nova-compute[75206]: WARNING nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state deleted and task_state None.
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:44 user nova-compute[75206]: WARNING nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-unplugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state deleted and task_state None.
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Acquiring lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:44 user nova-compute[75206]: DEBUG nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] No waiting events found dispatching network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:44 user nova-compute[75206]: WARNING nova.compute.manager [req-deb25489-e814-4921-8910-fd90310782fc req-b994be99-6265-48c1-85f5-eef5f91201d4 service nova] [instance: 03750708-8c0e-455e-a83b-5f8ca663c30f] Received unexpected event network-vif-plugged-b183fab9-60ca-4bcd-bbf2-28aee7faca2f for instance with vm_state deleted and task_state None.
Nov 29 22:22:44 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Deleted allocations for instance 03750708-8c0e-455e-a83b-5f8ca663c30f
Nov 29 22:22:44 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-61033f22-756b-4a75-b229-d3b67cd839ca tempest-SnapshotDataIntegrityTests-2032178691 tempest-SnapshotDataIntegrityTests-2032178691-project-member] Lock "03750708-8c0e-455e-a83b-5f8ca663c30f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:45 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 is timed out.
Nov 29 22:22:45 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully detached device vdc from instance 2a0f08b0-baac-4640-a533-5b4be46de2b6 from the live domain config.
Nov 29 22:22:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWfcdvgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:22:45 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e0ef30-80ab-4934-b6c4-55f6d4f87dce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:22:45 user nova-compute[75206]: No targets found.
Nov 29 22:22:45 user nova-compute[75206]: iSNS:
Nov 29 22:22:45 user nova-compute[75206]: No targets found.
Nov 29 22:22:45 user nova-compute[75206]: STATIC:
Nov 29 22:22:45 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:22:45 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:22:45 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:22:45 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254
Nov 29 22:22:45 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:22:45 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:22:45 user nova-compute[75206]: FIRMWARE:
Nov 29 22:22:45 user nova-compute[75206]: No targets found.
Nov 29 22:22:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:22:45 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:22:45 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a95785c-caac-499a-a38b-5d268f8aa080]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[55179f66-ff90-432a-b8e6-3057d6d027b0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:45 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 (non-flash)
Nov 29 22:22:45 user nova-compute[75206]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:22:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b82009d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254'): ({'sdc'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Removing single pathed devices sdc {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[94312714-0a72-4b68-ac93-c3404fa7b367]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef3569-749d-4371-91c3-2ebea9eca5a9]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Flushing IO for device /dev/sdc {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d51d45-7729-4550-833d-896472e59b31]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[df64d54d-9bdb-4f3c-84b8-ebbbad6f2cff]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] SCSI volumes sdc have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d821f0d-c3c2-4215-b2fb-e1367b7e4a0e]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8d4c7-5dd1-4f00-9ff8-162369c48d57]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260]
Nov 29 22:22:45 user nova-compute[75206]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254, portal: 172.16.0.220,3260] successful.
Nov 29 22:22:45 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22c4125-857e-4442-9018-9a4ca26cd254 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e25630-e49f-4acc-9613-9f497b58975f]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] <== disconnect_volume: return (279ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:22:45 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:22:46 user nova-compute[75206]: DEBUG nova.objects.instance [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'flavor' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-0fc756be-fc31-47f4-9646-20ff1ff3b1ce tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.872s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:47 user nova-compute[75206]: INFO nova.compute.manager [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Terminating instance
Nov 29 22:22:47 user nova-compute[75206]: DEBUG nova.compute.manager [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-unplugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] No waiting events found dispatching network-vif-unplugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-95cfce3e-8bf5-4776-b1d3-0ea9f05fb42d req-b925db58-8f5b-4452-a41f-ac7e46a90738 service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-unplugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Instance destroyed successfully.
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.objects.instance [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lazy-loading 'resources' on Instance uuid 2a0f08b0-baac-4640-a533-5b4be46de2b6 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:19:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1145903298',display_name='tempest-AttachVolumeTestJSON-server-1145903298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1145903298',id=50,image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBmyN/8z3OkuKIDmnZW5ByHFtnGCDcqepdwXvQD8Q1vK/8S825gLpsSwwQJElJAZbk2KuXK8/CQb5PPyI0ckB7voQmrJsk5h0zzyOWla1CPeqXGO6nTzYN6hDdmTEWDsg==',key_name='tempest-keypair-230282176',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:19:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4edbbd3bc5d74985817fc88839c58e4f',ramdisk_id='',reservation_id='r-p07beobr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e44a9200-b3d6-4f4e-ad54-1d5f3c3efa4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1138208547',owner_user_name='tempest-AttachVolumeTestJSON-1138208547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fec00476dc9c48e589ba6105b5b5cf7c',uuid=2a0f08b0-baac-4640-a533-5b4be46de2b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converting VIF {"id": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "address": "fa:16:3e:34:ab:7a", "network": {"id": "6bf10b9d-0abf-4d0a-a44a-c71ac891aee0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1929866147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4edbbd3bc5d74985817fc88839c58e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2c2a451-a4", "ovs_interfaceid": "a2c2a451-a4c1-4c87-a31d-357ed7797bd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG os_vif [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2c2a451-a4, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fdcfd18-f965-43fd-904e-2ae2b08f87b3) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:48 user nova-compute[75206]: INFO os_vif [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:ab:7a,bridge_name='br-int',has_traffic_filtering=True,id=a2c2a451-a4c1-4c87-a31d-357ed7797bd7,network=Network(6bf10b9d-0abf-4d0a-a44a-c71ac891aee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2c2a451-a4')
Nov 29 22:22:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Deleting instance files /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6_del
Nov 29 22:22:48 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Deletion of /opt/stack/data/nova/instances/2a0f08b0-baac-4640-a533-5b4be46de2b6_del complete
Nov 29 22:22:48 user nova-compute[75206]: INFO nova.compute.manager [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 22:22:48 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:22:48 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:22:49 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Took 0.67 seconds to deallocate network for instance.
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:49 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Deleted allocations for instance 2a0f08b0-baac-4640-a533-5b4be46de2b6
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-db87e140-1b4a-45ba-a7e7-e30030837ccc tempest-AttachVolumeTestJSON-1138208547 tempest-AttachVolumeTestJSON-1138208547-project-member] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] Acquiring lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] Lock "2a0f08b0-baac-4640-a533-5b4be46de2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] No waiting events found dispatching network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:22:49 user nova-compute[75206]: WARNING nova.compute.manager [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received unexpected event network-vif-plugged-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 for instance with vm_state deleted and task_state None.
Nov 29 22:22:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-ea6cadba-0e2e-4df1-9681-aada5483ad0f req-435a3b6d-56d5-4d1b-b8b1-04ce9df298ea service nova] [instance: 2a0f08b0-baac-4640-a533-5b4be46de2b6] Received event network-vif-deleted-a2c2a451-a4c1-4c87-a31d-357ed7797bd7 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:22:52 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:22:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:22:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.968265533447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b7fff54-97a3-4b9a-80fb-c77cfc279772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:22:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:22:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:22:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:22:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:22:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:23:08 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:13 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:18 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:23:23 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:28 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:33 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:38 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:43 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG nova.compute.manager [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing instance network info cache due to event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated VIF entry in instance network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG nova.network.neutron [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:23:46 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-0629f414-eb98-456d-97f8-de85f36a8986 req-ca4e9338-a140-439f-a4e1-f8387aec7b10 service nova] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:23:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:48 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:23:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:23:53 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=24.966236114501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b7fff54-97a3-4b9a-80fb-c77cfc279772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:23:53 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:23:54 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Starting instance... {{(pid=75206) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75206) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 22:23:55 user nova-compute[75206]: INFO nova.compute.claims [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Claim successful on node user
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Start building networks asynchronously for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Allocating IP information in the background. {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] allocate_for_instance() {{(pid=75206) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 22:23:55 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Start building block device mappings for instance. {{(pid=75206) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG nova.policy [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a98f791449794479934ed124c0993117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52051df2c77b4f8487b6922bea48503e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75206) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 22:23:55 user nova-compute[75206]: INFO nova.virt.block_device [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Booting with volume 7d56a361-b02e-4884-aa0c-1b3207c42456 at /dev/vda
Nov 29 22:23:55 user nova-compute[75206]: DEBUG os_brick.utils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:23:55 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43527785-997b-4351-92c8-60d83064ebf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c6eff5f5ba44\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa587b-8d22-465b-a0b8-d7c0429e3fcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a123934a-e33e-455a-a98a-a5ea0a20998f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb96a854-b483-409c-8ea1-8eeefe914d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Running cmd (subprocess): nvme version {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75206) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] nvme not present on system {{(pid=75206) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 22:23:56 user nova-compute[75206]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 22:23:56 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac51b6a-01d6-4cad-899c-2992553612ba]: (4, '') {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75206) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.lightos [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] LIGHTOS: no hostnqn found. {{(pid=75206) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG os_brick.utils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c6eff5f5ba44', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG nova.virt.block_device [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating existing volume attachment record: 59943de3-91e2-49c1-8716-23343ab5aa4f {{(pid=75206) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 22:23:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Successfully created port: e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Successfully updated port: e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquired lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Building network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.compute.manager [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing instance network info cache due to event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] Acquiring lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Instance cache missing network info. {{(pid=75206) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating instance_info_cache with network_info: [{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Releasing lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Instance network_info: |[{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75206) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] Acquired lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:23:57 user nova-compute[75206]: DEBUG nova.network.neutron [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updated VIF entry in instance network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG nova.network.neutron [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating instance_info_cache with network_info: [{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-85effd02-01c0-4d73-a2ce-66c5711fdf5c req-9f1d4871-05ba-4e9d-9d46-732836fa9f6a service nova] Releasing lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:23:58 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:23:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:02 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:02 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:03 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Start spawning the instance on the hypervisor. {{(pid=75206) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Creating instance directory {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 22:24:04 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Creating image(s)
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Did not create local disks {{(pid=75206) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Ensure instance console log exists: /opt/stack/data/nova/instances/4d28ef49-1086-4651-8407-ccac891d3732/console.log {{(pid=75206) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Start _get_guest_xml network_info=[{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'attachment_id': '59943de3-91e2-49c1-8716-23343ab5aa4f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brCSkPan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d28ef49-1086-4651-8407-ccac891d3732', 'attached_at': '', 'detached_at': '', 'volume_id': '7d56a361-b02e-4884-aa0c-1b3207c42456', 'serial': '7d56a361-b02e-4884-aa0c-1b3207c42456'}, 'disk_bus': 'virtio', 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 22:24:04 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:24:04 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller missing on host. {{(pid=75206) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.host [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU controller found on host. {{(pid=75206) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75206) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T21:41:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image limits 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flavor pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Image pref 0:0:0 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75206) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Got 1 possible topologies {{(pid=75206) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.hardware [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75206) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Calling os-brick to attach iSCSI Volume {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brCSkPan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:24:04 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:24:04 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:24:04 user nova-compute[75206]: INFO os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07f59c-bfd9-417e-8aeb-21fb1881e6b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 22:24:04 user nova-compute[75206]:  {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --interface default --op new {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d7902-7ee9-4a23-a5c5-57ee87891505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456] added\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456] added
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9cb376-182d-49f1-a125-c85e22d96901]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e5c5f-7c8d-4abd-92dc-15520fcb9775]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brCSkPan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brCSkPan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbdacea-ff83-4f30-8120-878bbe9a02de]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'brCSkPan'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cac45b-5570-4da2-87c2-221d50d9ad71]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a891d-e4f5-43cb-8634-f2a4ad00d682]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --login {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6530b-c621-431d-a906-563b62649c25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260]
Nov 29 22:24:04 user nova-compute[75206]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260] successful.
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[767e7fb2-ab84-4a5b-b526-e25411c2e3d9]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1151ac-2e26-487b-aa56-5a4cb112be15]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:24:04 user nova-compute[75206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:24:04 user nova-compute[75206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)
Nov 29 22:24:04 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to 172.16.0.220:3260 {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75206) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75206) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8249f2-3868-4c6a-85a0-6bcfea369cc2]: (4, ('- - 0', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:24:04 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75206) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brCSkPan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75206) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23362306239353036', 'path': '/dev/sdb'} {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362306239353036', 'path': '/dev/sdb'} {{(pid=75206) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778430238',display_name='tempest-TestVolumeBootPattern-server-1778430238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778430238',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-e6u2g2q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:23:56Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=4d28ef49-1086-4651-8407-ccac891d3732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75206) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.objects.instance [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d28ef49-1086-4651-8407-ccac891d3732 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] End _get_guest_xml xml=<domain type="kvm">
Nov 29 22:24:05 user nova-compute[75206]:   <uuid>4d28ef49-1086-4651-8407-ccac891d3732</uuid>
Nov 29 22:24:05 user nova-compute[75206]:   <name>instance-00000034</name>
Nov 29 22:24:05 user nova-compute[75206]:   <memory>524288</memory>
Nov 29 22:24:05 user nova-compute[75206]:   <vcpu>1</vcpu>
Nov 29 22:24:05 user nova-compute[75206]:   <metadata>
Nov 29 22:24:05 user nova-compute[75206]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 22:24:05 user nova-compute[75206]:       <nova:package version="0.0.0"/>
Nov 29 22:24:05 user nova-compute[75206]:       <nova:name>tempest-TestVolumeBootPattern-server-1778430238</nova:name>
Nov 29 22:24:05 user nova-compute[75206]:       <nova:creationTime>2023-11-29 22:24:04</nova:creationTime>
Nov 29 22:24:05 user nova-compute[75206]:       <nova:flavor name="m1.tiny">
Nov 29 22:24:05 user nova-compute[75206]:         <nova:memory>512</nova:memory>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:disk>1</nova:disk>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:swap>0</nova:swap>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:vcpus>1</nova:vcpus>
Nov 29 22:24:05 user nova-compute[75206]:       </nova:flavor>
Nov 29 22:24:05 user nova-compute[75206]:       <nova:owner>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:user uuid="a98f791449794479934ed124c0993117">tempest-TestVolumeBootPattern-174206339-project-member</nova:user>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:project uuid="52051df2c77b4f8487b6922bea48503e">tempest-TestVolumeBootPattern-174206339</nova:project>
Nov 29 22:24:05 user nova-compute[75206]:       </nova:owner>
Nov 29 22:24:05 user nova-compute[75206]:       <nova:ports>
Nov 29 22:24:05 user nova-compute[75206]:         <nova:port uuid="e8fed81a-b554-45f9-86ad-6029d358fcbd">
Nov 29 22:24:05 user nova-compute[75206]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 22:24:05 user nova-compute[75206]:         </nova:port>
Nov 29 22:24:05 user nova-compute[75206]:       </nova:ports>
Nov 29 22:24:05 user nova-compute[75206]:     </nova:instance>
Nov 29 22:24:05 user nova-compute[75206]:   </metadata>
Nov 29 22:24:05 user nova-compute[75206]:   <sysinfo type="smbios">
Nov 29 22:24:05 user nova-compute[75206]:     <system>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="product">OpenStack Nova</entry>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="version">0.0.0</entry>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="serial">4d28ef49-1086-4651-8407-ccac891d3732</entry>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="uuid">4d28ef49-1086-4651-8407-ccac891d3732</entry>
Nov 29 22:24:05 user nova-compute[75206]:       <entry name="family">Virtual Machine</entry>
Nov 29 22:24:05 user nova-compute[75206]:     </system>
Nov 29 22:24:05 user nova-compute[75206]:   </sysinfo>
Nov 29 22:24:05 user nova-compute[75206]:   <os>
Nov 29 22:24:05 user nova-compute[75206]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 22:24:05 user nova-compute[75206]:     <boot dev="hd"/>
Nov 29 22:24:05 user nova-compute[75206]:     <smbios mode="sysinfo"/>
Nov 29 22:24:05 user nova-compute[75206]:   </os>
Nov 29 22:24:05 user nova-compute[75206]:   <features>
Nov 29 22:24:05 user nova-compute[75206]:     <acpi/>
Nov 29 22:24:05 user nova-compute[75206]:     <apic/>
Nov 29 22:24:05 user nova-compute[75206]:     <vmcoreinfo/>
Nov 29 22:24:05 user nova-compute[75206]:   </features>
Nov 29 22:24:05 user nova-compute[75206]:   <clock offset="utc">
Nov 29 22:24:05 user nova-compute[75206]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 22:24:05 user nova-compute[75206]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 22:24:05 user nova-compute[75206]:     <timer name="hpet" present="no"/>
Nov 29 22:24:05 user nova-compute[75206]:   </clock>
Nov 29 22:24:05 user nova-compute[75206]:   <cpu mode="custom" match="exact">
Nov 29 22:24:05 user nova-compute[75206]:     <model>Nehalem</model>
Nov 29 22:24:05 user nova-compute[75206]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 22:24:05 user nova-compute[75206]:   </cpu>
Nov 29 22:24:05 user nova-compute[75206]:   <devices>
Nov 29 22:24:05 user nova-compute[75206]:     <disk type="block" device="disk">
Nov 29 22:24:05 user nova-compute[75206]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 22:24:05 user nova-compute[75206]:       <source dev="/dev/sdb"/>
Nov 29 22:24:05 user nova-compute[75206]:       <target dev="vda" bus="virtio"/>
Nov 29 22:24:05 user nova-compute[75206]:       <serial>7d56a361-b02e-4884-aa0c-1b3207c42456</serial>
Nov 29 22:24:05 user nova-compute[75206]:     </disk>
Nov 29 22:24:05 user nova-compute[75206]:     <interface type="ethernet">
Nov 29 22:24:05 user nova-compute[75206]:       <mac address="fa:16:3e:ea:1e:a7"/>
Nov 29 22:24:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:24:05 user nova-compute[75206]:       <mtu size="1442"/>
Nov 29 22:24:05 user nova-compute[75206]:       <target dev="tape8fed81a-b5"/>
Nov 29 22:24:05 user nova-compute[75206]:     </interface>
Nov 29 22:24:05 user nova-compute[75206]:     <serial type="pty">
Nov 29 22:24:05 user nova-compute[75206]:       <log file="/opt/stack/data/nova/instances/4d28ef49-1086-4651-8407-ccac891d3732/console.log" append="off"/>
Nov 29 22:24:05 user nova-compute[75206]:     </serial>
Nov 29 22:24:05 user nova-compute[75206]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 22:24:05 user nova-compute[75206]:     <video>
Nov 29 22:24:05 user nova-compute[75206]:       <model type="virtio"/>
Nov 29 22:24:05 user nova-compute[75206]:     </video>
Nov 29 22:24:05 user nova-compute[75206]:     <rng model="virtio">
Nov 29 22:24:05 user nova-compute[75206]:       <backend model="random">/dev/urandom</backend>
Nov 29 22:24:05 user nova-compute[75206]:     </rng>
Nov 29 22:24:05 user nova-compute[75206]:     <controller type="usb" index="0" model="none"/>
Nov 29 22:24:05 user nova-compute[75206]:     <memballoon model="virtio">
Nov 29 22:24:05 user nova-compute[75206]:       <stats period="10"/>
Nov 29 22:24:05 user nova-compute[75206]:     </memballoon>
Nov 29 22:24:05 user nova-compute[75206]:   </devices>
Nov 29 22:24:05 user nova-compute[75206]: </domain>
Nov 29 22:24:05 user nova-compute[75206]:  {{(pid=75206) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778430238',display_name='tempest-TestVolumeBootPattern-server-1778430238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778430238',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-e6u2g2q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T22:23:56Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=4d28ef49-1086-4651-8407-ccac891d3732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG os_vif [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5') {{(pid=75206) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48bf4dbd-a328-5c8c-8b78-e6388f70ae10', '_type': 'linux-noop'}}, row=False) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8fed81a-b5, may_exist=True, interface_attrs={}) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8fed81a-b5, col_values=(('qos', UUID('f2207de5-53a2-483d-b55d-d90068fa0d4e')),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8fed81a-b5, col_values=(('external_ids', {'iface-id': 'e8fed81a-b554-45f9-86ad-6029d358fcbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:1e:a7', 'vm-uuid': '4d28ef49-1086-4651-8407-ccac891d3732'}),), if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:05 user nova-compute[75206]: INFO os_vif [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5')
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75206) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 22:24:05 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] No VIF found with MAC fa:16:3e:ea:1e:a7, not building metadata {{(pid=75206) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 22:24:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:06 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG nova.compute.manager [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] No waiting events found dispatching network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:24:07 user nova-compute[75206]: WARNING nova.compute.manager [req-b9490642-1f90-4df8-9a17-0867d3075057 req-03c4b27b-25d0-4d5c-b972-f593b432ee1e service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received unexpected event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd for instance with vm_state building and task_state spawning.
Nov 29 22:24:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:07 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Instance event wait completed in 0 seconds for  {{(pid=75206) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Guest created on hypervisor {{(pid=75206) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 22:24:08 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Instance spawned successfully.
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_cdrom_bus of ide {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_disk_bus of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_input_bus of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_pointer_model of None {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_video_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:08 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Found default for hw_vif_model of virtio {{(pid=75206) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 22:24:09 user nova-compute[75206]: INFO nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 29 22:24:09 user nova-compute[75206]: DEBUG nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Checking state {{(pid=75206) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 22:24:09 user nova-compute[75206]: INFO nova.compute.manager [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Took 13.60 seconds to build instance.
Nov 29 22:24:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:24:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:24:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:24:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:09 user nova-compute[75206]: DEBUG nova.compute.manager [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] No waiting events found dispatching network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:24:09 user nova-compute[75206]: WARNING nova.compute.manager [req-408705c0-effe-42bc-b59b-a315e88372bc req-8983911a-f310-447f-93c0-54361dec1f7a service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received unexpected event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd for instance with vm_state active and task_state None.
Nov 29 22:24:09 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-67093ada-ef8d-4bc1-bfc2-b331bf331c07 tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.695s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:17 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:22 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:27 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:32 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:37 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:24:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:24:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:50 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:24:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:24:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:24:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=24.95534896850586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b7fff54-97a3-4b9a-80fb-c77cfc279772 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 4d28ef49-1086-4651-8407-ccac891d3732 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:24:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Forcefully refreshing network info cache for instance {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 22:24:56 user nova-compute[75206]: DEBUG nova.objects.instance [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lazy-loading 'info_cache' on Instance uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:24:57 user nova-compute[75206]: DEBUG nova.network.neutron [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:24:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:24:57 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated the network info_cache for instance {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 22:24:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:24:59 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:00 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:01 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:01 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:04 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:05 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:10 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:15 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:20 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:25 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:30 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:35 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:25:40 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG nova.compute.manager [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing instance network info cache due to event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] Acquiring lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] Acquired lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updated VIF entry in instance network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG nova.network.neutron [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating instance_info_cache with network_info: [{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-fc1ccd3f-7165-4e43-9ad3-7203c1019ca9 req-7826ed1a-ba9d-4ab7-b0b6-e65b02f9103d service nova] Releasing lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:25:47 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:48 user nova-compute[75206]: INFO nova.compute.manager [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Terminating instance
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing instance network info cache due to event network-changed-e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] Acquiring lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] Acquired lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Refreshing network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-unplugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] No waiting events found dispatching network-vif-unplugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-b9872096-6b56-4e8a-9aff-7be15d0005f1 req-1cda4686-d3c8-42ce-a767-1c36521bb322 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-unplugged-e8fed81a-b554-45f9-86ad-6029d358fcbd for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updated VIF entry in instance network info cache for port e8fed81a-b554-45f9-86ad-6029d358fcbd. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating instance_info_cache with network_info: [{"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:25:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-209e7ab6-0196-460e-a62a-6071153ac39f req-ec8548cd-003f-4ad0-a9ff-ca7c9c757255 service nova] Releasing lock "refresh_cache-4d28ef49-1086-4651-8407-ccac891d3732" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Instance destroyed successfully.
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid 4d28ef49-1086-4651-8407-ccac891d3732 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1778430238',display_name='tempest-TestVolumeBootPattern-server-1778430238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1778430238',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:24:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-e6u2g2q8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:24:09Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=4d28ef49-1086-4651-8407-ccac891d3732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "address": "fa:16:3e:ea:1e:a7", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8fed81a-b5", "ovs_interfaceid": "e8fed81a-b554-45f9-86ad-6029d358fcbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_vif [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8fed81a-b5, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2207de5-53a2-483d-b55d-d90068fa0d4e) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:25:49 user nova-compute[75206]: INFO os_vif [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:1e:a7,bridge_name='br-int',has_traffic_filtering=True,id=e8fed81a-b554-45f9-86ad-6029d358fcbd,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8fed81a-b5')
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brCSkPan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:25:49 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f32fcf7-134b-44db-9298-0e04e4228382]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:25:49 user nova-compute[75206]: No targets found.
Nov 29 22:25:49 user nova-compute[75206]: iSNS:
Nov 29 22:25:49 user nova-compute[75206]: No targets found.
Nov 29 22:25:49 user nova-compute[75206]: STATIC:
Nov 29 22:25:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:25:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:25:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:25:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456
Nov 29 22:25:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:25:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:25:49 user nova-compute[75206]: FIRMWARE:
Nov 29 22:25:49 user nova-compute[75206]: No targets found.
Nov 29 22:25:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:25:49 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:25:49 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[657efa0d-325e-468a-bb42-ae9f76dfc3b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7f52d-c941-4ae9-9cdd-fd707646fb12]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:25:49 user nova-compute[75206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)
Nov 29 22:25:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:25:49 user nova-compute[75206]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 (non-flash)
Nov 29 22:25:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b82035b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456'): ({'sdb'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdb {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b099150-961e-41fd-8ffb-a59ba8df0a5f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda40888-9ef6-4962-8346-fc0f546c038c]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdb {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b46245-399d-4194-80cb-73ca988bc7e0]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d76ef-884e-4f9a-82e7-878054472171]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdb have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f669c15-29ca-4c36-8b41-f770d3a5bfe5]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd736e-09a1-4515-af5b-592f0d759cb7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260]
Nov 29 22:25:49 user nova-compute[75206]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456, portal: 172.16.0.220,3260] successful.
Nov 29 22:25:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d56a361-b02e-4884-aa0c-1b3207c42456 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0854488-a17a-49b5-a9e0-430c4aad1617]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (288ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:25:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Deleting instance files /opt/stack/data/nova/instances/4d28ef49-1086-4651-8407-ccac891d3732_del
Nov 29 22:25:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Deletion of /opt/stack/data/nova/instances/4d28ef49-1086-4651-8407-ccac891d3732_del complete
Nov 29 22:25:49 user nova-compute[75206]: INFO nova.compute.manager [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 22:25:49 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:25:49 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Took 0.40 seconds to deallocate network for instance.
Nov 29 22:25:49 user nova-compute[75206]: DEBUG nova.compute.manager [req-3826e876-7b3c-4fab-b253-f9b7e226f3b1 req-e69d9684-8fa4-4146-81e2-d049a79f9613 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-deleted-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] Acquiring lock "4d28ef49-1086-4651-8407-ccac891d3732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] Lock "4d28ef49-1086-4651-8407-ccac891d3732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] No waiting events found dispatching network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:25:50 user nova-compute[75206]: WARNING nova.compute.manager [req-4a0d97b4-4387-432f-93d2-0cf15d76faa9 req-a2101f8f-87f7-4f43-ac8c-46a6cc7cd773 service nova] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Received unexpected event network-vif-plugged-e8fed81a-b554-45f9-86ad-6029d358fcbd for instance with vm_state active and task_state deleting.
Nov 29 22:25:50 user nova-compute[75206]: INFO nova.compute.manager [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 4d28ef49-1086-4651-8407-ccac891d3732] Took 0.98 seconds to detach 1 volumes for instance.
Nov 29 22:25:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:51 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:25:51 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:25:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:51 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance 4d28ef49-1086-4651-8407-ccac891d3732
Nov 29 22:25:51 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-6d22e65a-cb9c-4711-9a35-bfb7dbd9441c tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "4d28ef49-1086-4651-8407-ccac891d3732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:52 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:54 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75206) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 22:25:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:25:55 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.95330810546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Instance 3b7fff54-97a3-4b9a-80fb-c77cfc279772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75206) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:25:55 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:25:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:25:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:25:59 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:25:59 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:25:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:01 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:01 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:05 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG nova.compute.manager [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing instance network info cache due to event network-changed-7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] Acquiring lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] Acquired lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG nova.network.neutron [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Refreshing network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:48 user nova-compute[75206]: INFO nova.compute.manager [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Terminating instance
Nov 29 22:26:48 user nova-compute[75206]: DEBUG nova.compute.manager [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Start destroying the instance on the hypervisor. {{(pid=75206) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:48 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Instance destroyed successfully.
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.objects.instance [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lazy-loading 'resources' on Instance uuid 3b7fff54-97a3-4b9a-80fb-c77cfc279772 {{(pid=75206) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.vif [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T22:21:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1255557720',display_name='tempest-TestVolumeBootPattern-server-1255557720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1255557720',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNOiD2FP1X27JMjq226mSJM6n3+NnrJngAGQDOyup9xwptJUqghqjxuSMuwco1GfmFGeR/JGr+0KYk+L1y74Fl/OVar+w4I+/CcORXdkBLYUbzhpr9KqzJHWD59o1hRyw==',key_name='tempest-TestVolumeBootPattern-1065356880',keypairs=<?>,launch_index=0,launched_at=2023-11-29T22:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52051df2c77b4f8487b6922bea48503e',ramdisk_id='',reservation_id='r-60zne9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-174206339',owner_user_name='tempest-TestVolumeBootPattern-174206339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T22:22:08Z,user_data=None,user_id='a98f791449794479934ed124c0993117',uuid=3b7fff54-97a3-4b9a-80fb-c77cfc279772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converting VIF {"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.os_vif_util [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce') {{(pid=75206) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_vif [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce') {{(pid=75206) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f082237-ce, bridge=br-int, if_exists=True) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bae1a9c0-32cd-44a8-bc8b-d7dab336086a) {{(pid=75206) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:49 user nova-compute[75206]: INFO os_vif [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:96:9c,bridge_name='br-int',has_traffic_filtering=True,id=7f082237-ced2-40ad-9f5a-927f43b15766,network=Network(75d8ff2f-fa09-4de1-bae9-7a40d801ffb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f082237-ce')
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] calling os-brick to detach iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24c8113040>, {'target_iqn': 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTzSJWxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 22:26:49 user nova-compute[75206]: WARNING os_brick.initiator.connectors.base [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87aa0a-140f-4efd-8330-fe0d5cf753cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 22:26:49 user nova-compute[75206]: No targets found.
Nov 29 22:26:49 user nova-compute[75206]: iSNS:
Nov 29 22:26:49 user nova-compute[75206]: No targets found.
Nov 29 22:26:49 user nova-compute[75206]: STATIC:
Nov 29 22:26:49 user nova-compute[75206]: Target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef
Nov 29 22:26:49 user nova-compute[75206]:         Portal: 172.16.0.220:3260,-1
Nov 29 22:26:49 user nova-compute[75206]:                 Iface Name: default
Nov 29 22:26:49 user nova-compute[75206]: FIRMWARE:
Nov 29 22:26:49 user nova-compute[75206]: No targets found.
Nov 29 22:26:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 22:26:49 user nova-compute[75206]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 22:26:49 user nova-compute[75206]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75206) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef', 0)] {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[109823ee-4af5-4fa2-9d4c-34ca45c962f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad53ce42-6cde-4e50-84b3-aeb66da5360f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:26:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef (non-flash)
Nov 29 22:26:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24c807dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef'): ({'sdd'}, set())}) {{(pid=75206) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Removing single pathed devices sdd {{(pid=75206) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109a542-0d01-4757-ab39-251ef15c7809]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d39d61-aba6-49ac-9229-93fc1ab25afe]: (4, ('ok\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Flushing IO for device /dev/sdd {{(pid=75206) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386f031-c784-4c91-bc6e-a26da8e68378]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75206) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updated VIF entry in instance network info cache for port 7f082237-ced2-40ad-9f5a-927f43b15766. {{(pid=75206) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.neutron [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [{"id": "7f082237-ced2-40ad-9f5a-927f43b15766", "address": "fa:16:3e:d4:96:9c", "network": {"id": "75d8ff2f-fa09-4de1-bae9-7a40d801ffb4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1143096178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52051df2c77b4f8487b6922bea48503e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f082237-ce", "ovs_interfaceid": "7f082237-ced2-40ad-9f5a-927f43b15766", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c6b13c-5e52-4d38-9d3b-45c400ecee83]: (4, ('1', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.linuxscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] SCSI volumes sdd have been removed. {{(pid=75206) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef')] {{(pid=75206) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-9504cccf-2520-4eba-97b3-19ffa9aef3ae req-6ba3e9c5-b4ce-4a11-a608-cdee734402fb service nova] Releasing lock "refresh_cache-3b7fff54-97a3-4b9a-80fb-c77cfc279772" {{(pid=75206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422ab1d-7fce-4f41-9d09-848ce938f933]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --logout {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a3ce3-3b79-418d-9a63-d2d69e48e05e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260]
Nov 29 22:26:49 user nova-compute[75206]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef, portal: 172.16.0.220,3260] successful.
Nov 29 22:26:49 user nova-compute[75206]:  stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op delete {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a89b249-1376-457e-ac6f-0cdd073175ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85661) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5922c72d-1d65-4961-bb36-136721970f93]: (4, ('', '')) {{(pid=85661) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75206) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.base [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] <== disconnect_volume: return (332ms) None {{(pid=75206) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Disconnected iSCSI Volume {{(pid=75206) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 22:26:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Deleting instance files /opt/stack/data/nova/instances/3b7fff54-97a3-4b9a-80fb-c77cfc279772_del
Nov 29 22:26:49 user nova-compute[75206]: INFO nova.virt.libvirt.driver [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Deletion of /opt/stack/data/nova/instances/3b7fff54-97a3-4b9a-80fb-c77cfc279772_del complete
Nov 29 22:26:49 user nova-compute[75206]: INFO nova.compute.manager [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 22:26:49 user nova-compute[75206]: DEBUG oslo.service.loopingcall [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75206) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.compute.manager [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Deallocating network for instance {{(pid=75206) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] deallocate_for_instance() {{(pid=75206) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 22:26:49 user nova-compute[75206]: DEBUG nova.network.neutron [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Updating instance_info_cache with network_info: [] {{(pid=75206) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 22:26:49 user nova-compute[75206]: INFO nova.compute.manager [-] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Took 0.35 seconds to deallocate network for instance.
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-unplugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] No waiting events found dispatching network-vif-unplugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-unplugged-7f082237-ced2-40ad-9f5a-927f43b15766 for instance with task_state deleting. {{(pid=75206) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Acquiring lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] No waiting events found dispatching network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 22:26:50 user nova-compute[75206]: WARNING nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received unexpected event network-vif-plugged-7f082237-ced2-40ad-9f5a-927f43b15766 for instance with vm_state active and task_state deleting.
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.manager [req-69b78e03-30f3-45e1-b810-2b3b1e71951d req-aa37a123-c9ba-4875-8738-a8482b539b3f service nova] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Received event network-vif-deleted-7f082237-ced2-40ad-9f5a-927f43b15766 {{(pid=75206) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 22:26:50 user nova-compute[75206]: INFO nova.compute.manager [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] [instance: 3b7fff54-97a3-4b9a-80fb-c77cfc279772] Took 0.73 seconds to detach 1 volumes for instance.
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:50 user nova-compute[75206]: INFO nova.scheduler.client.report [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Deleted allocations for instance 3b7fff54-97a3-4b9a-80fb-c77cfc279772
Nov 29 22:26:50 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-7ed4ef13-2d40-4d30-91f2-711703e8be4d tempest-TestVolumeBootPattern-174206339 tempest-TestVolumeBootPattern-174206339-project-member] Lock "3b7fff54-97a3-4b9a-80fb-c77cfc279772" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:26:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:26:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=24.952457427978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:26:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:26:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:26:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:26:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:26:58 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:26:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:01 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:27:01 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:01 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75206) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 22:27:02 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:03 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:03 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:06 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:21 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:23 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Cleaning up deleted instances {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 22:27:23 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] There are 0 instances to clean {{(pid=75206) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 22:27:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:27:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:45 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:46 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:49 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:27:56 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:27:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:27:57 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=9303MB free_disk=24.94967269897461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Refreshing inventories for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Updating ProviderTree inventory for provider 51ff9dac-8442-4423-a757-45ab0a497b95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Updating inventory in ProviderTree for provider 51ff9dac-8442-4423-a757-45ab0a497b95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Refreshing aggregate associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, aggregates: None {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Refreshing trait associations for resource provider 51ff9dac-8442-4423-a757-45ab0a497b95, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=75206) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:27:57 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:27:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:00 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:28:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:28:00 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:28:03 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:03 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:05 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:08 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:29 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:34 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:39 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:44 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75206) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75206) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 22:28:49 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:28:50 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:54 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Auditing locally available compute resources for user (node: user) {{(pid=75206) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 22:28:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:28:58 user nova-compute[75206]: WARNING nova.virt.libvirt.driver [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Hypervisor/Node resource view: name=user free_ram=9318MB free_disk=24.943523406982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75206) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75206) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.provider_tree [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed in ProviderTree for provider: 51ff9dac-8442-4423-a757-45ab0a497b95 {{(pid=75206) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.scheduler.client.report [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Inventory has not changed for provider 51ff9dac-8442-4423-a757-45ab0a497b95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75206) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG nova.compute.resource_tracker [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Compute_service record updated for user:user {{(pid=75206) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 22:28:58 user nova-compute[75206]: DEBUG oslo_concurrency.lockutils [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75206) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 22:28:59 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:29:02 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Starting heal instance info cache {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 22:29:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Rebuilding the list of instances to heal {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 22:29:02 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Didn't find any instances for network info cache update. {{(pid=75206) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 22:29:03 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:03 user nova-compute[75206]: DEBUG nova.compute.manager [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75206) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 22:29:04 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:04 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:29:05 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:06 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:09 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:29:10 user nova-compute[75206]: DEBUG oslo_service.periodic_task [None req-2f090aca-df04-49f7-b5c5-42369c762337 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75206) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 22:29:14 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 22:29:19 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 22:29:24 user nova-compute[75206]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75206) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}